2017/03/26 03:47:29 (6723) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Timeout 2017/03/26 03:47:29 (6723) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Timeout 2017/03/26 03:47:29 (6724) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/03/26 03:47:29 (6723) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/03/26 03:47:29 (6724) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/03/26 03:47:29 (6724) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/03/26 03:50:00 (6876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Timeout 2017/03/26 03:50:00 (6876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Timeout 2017/03/26 03:50:00 (6876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/03/26 03:50:28 (6882) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/03/26 03:50:28 (6882) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/03/26 03:50:28 (6882) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/03/26 03:50:31 (6888) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/03/26 03:50:31 (6888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/03/26 03:50:31 (6888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/01 01:05:02 (2388) ERROR> Owamp.pm:85 perfSONAR_PS::RegularTesting::Parsers::Owamp::parse_owamp_summary_file - Problem reading summary file: /var/lib/perfsonar/regulartesting/owamp_O_O32/15891414207944836617_15891414472789628880.sum: Config::General The file "/var/lib/perfsonar/regulartesting/owamp_O_O32/15891414207944836617_15891414472789628880.sum" does not exist within ConfigPath: /var/lib/perfsonar/regulartesting/owamp_O_O32! at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Parsers/Owamp.pm line 81 2017/04/01 01:05:02 (2388) ERROR> Powstream.pm:297 perfSONAR_PS::RegularTesting::Tests::Powstream::build_results - Problem parsing test results 2017/04/01 01:05:02 (2388) ERROR> Powstream.pm:261 perfSONAR_PS::RegularTesting::Tests::Powstream::handle_output - Problem parsing test results 2017/04/09 01:02:05 (20685) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/04/09 01:02:05 (20685) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/04/09 01:02:05 (20685) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/09 01:05:07 (20934) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/04/09 01:05:07 (20934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/04/09 01:05:07 (20934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/09 01:08:46 (21091) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/04/09 01:08:46 (21091) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/04/09 01:08:46 (21091) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/09 01:09:28 (21118) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/04/09 01:09:28 (21118) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/04/09 01:09:28 (21118) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/09 01:12:31 (21325) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/04/09 01:12:31 (21325) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/04/09 01:12:31 (21325) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/09 01:14:31 (21420) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/04/09 01:14:31 (21420) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/04/09 01:14:31 (21420) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/09 01:16:50 (21526) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (500) 500 Timeout 2017/04/09 01:16:50 (21526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 500 Timeout 2017/04/09 01:16:50 (21526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 500 Timeout at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/04/09 01:22:28 (21835) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type packet-count-sent at time 1491710447"} 2017/04/09 01:22:29 (21839) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type packet-count-sent at time 1491710675"} 2017/04/09 01:22:30 (21845) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type packet-count-sent at time 1491710853"} 2017/04/09 01:22:31 (21849) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type packet-count-sent at time 1491710895"} 2017/04/09 01:22:32 (21854) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type packet-count-sent at time 1491711072"} 2017/04/09 01:22:33 (21859) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type packet-count-sent at time 1491711197"} 2017/04/09 01:22:34 (21863) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type packet-count-sent at time 1491711332"} 2017/05/11 01:05:02 (2388) ERROR> Owamp.pm:85 perfSONAR_PS::RegularTesting::Parsers::Owamp::parse_owamp_summary_file - Problem reading summary file: /var/lib/perfsonar/regulartesting/owamp_O_O32/15906257529882160772_15906257793277771432.sum: Config::General The file "/var/lib/perfsonar/regulartesting/owamp_O_O32/15906257529882160772_15906257793277771432.sum" does not exist within ConfigPath: /var/lib/perfsonar/regulartesting/owamp_O_O32! at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Parsers/Owamp.pm line 81 2017/05/11 01:05:02 (2388) ERROR> Powstream.pm:297 perfSONAR_PS::RegularTesting::Tests::Powstream::build_results - Problem parsing test results 2017/05/11 01:05:02 (2388) ERROR> Powstream.pm:261 perfSONAR_PS::RegularTesting::Tests::Powstream::handle_output - Problem parsing test results 2017/06/06 15:04:59 (2388) ERROR> CmdRunner.pm:131 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - No results in 180 seconds (last result 1496772118). Killing process. 2017/06/06 15:05:01 (2388) ERROR> CmdRunner.pm:148 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will restart immediately : /usr/bin/powstream -4 -p -d /var/lib/perfsonar/regulartesting/owamp_nrJ8x -c 600 -i 0.1 -P 8760-9960 -S eth1 -t ps-lt.sdmz.rnp.br 2017/07/11 22:46:30 (2388) ERROR> CmdRunner.pm:131 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - No results in 180 seconds (last result 1499823807). Killing process. 2017/07/11 22:46:32 (2388) ERROR> CmdRunner.pm:148 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will restart immediately : /usr/bin/powstream -4 -p -d /var/lib/perfsonar/regulartesting/owamp_O_O32 -c 600 -i 0.1 -P 8760-9960 -S eth1 ps-lt.sdmz.rnp.br 2017/07/11 22:46:42 (2388) ERROR> CmdRunner.pm:131 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - No results in 180 seconds (last result 1499823819). Killing process. 2017/07/11 22:46:44 (2388) ERROR> CmdRunner.pm:148 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will restart immediately : /usr/bin/powstream -4 -p -d /var/lib/perfsonar/regulartesting/owamp_nrJ8x -c 600 -i 0.1 -P 8760-9960 -S eth1 -t ps-lt.sdmz.rnp.br 2017/07/30 08:02:47 (2388) ERROR> CmdRunner.pm:131 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - No results in 180 seconds (last result 1501412383). Killing process. 2017/07/30 08:02:49 (2388) ERROR> CmdRunner.pm:148 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will restart immediately : /usr/bin/powstream -4 -p -d /var/lib/perfsonar/regulartesting/owamp_nrJ8x -c 600 -i 0.1 -P 8760-9960 -S eth1 -t ps-lt.sdmz.rnp.br 2017/07/30 08:03:20 (2388) ERROR> CmdRunner.pm:131 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - No results in 180 seconds (last result 1501412417). Killing process. 2017/07/30 08:03:22 (2388) ERROR> CmdRunner.pm:148 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will restart immediately : /usr/bin/powstream -4 -p -d /var/lib/perfsonar/regulartesting/owamp_O_O32 -c 600 -i 0.1 -P 8760-9960 -S eth1 ps-lt.sdmz.rnp.br 2017/08/08 15:40:49 (33852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/08/08 15:40:49 (33852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/08/08 15:40:49 (33852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/08/26 16:16:27 (2361) WARN> regulartesting.pl:103 main::__ANON__ - Warned: IPC::DirQueue: killed stale lockfile: /var/lib/perfsonar/regulartesting/esmond_latency_localhost/active/active/50.20170808184048877071.EMTkwOQ at /usr/share/perl5/IPC/DirQueue.pm line 519. 2017/08/26 16:16:27 (2388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/08/26 16:16:27 (2388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/08/26 16:16:27 (2388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/10/06 04:02:57 (32073) WARN> regulartesting.pl:103 main::__ANON__ - Warned: Use of uninitialized value in concatenation (.) or string at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondTraceroute.pm line 37. 2017/10/10 00:02:43 (63186) WARN> regulartesting.pl:103 main::__ANON__ - Warned: Use of uninitialized value in concatenation (.) or string at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondTraceroute.pm line 37. 2017/10/23 14:54:07 (2399) WARN> regulartesting.pl:103 main::__ANON__ - Warned: IPC::DirQueue: killed stale lockfile: /var/lib/perfsonar/regulartesting/esmond_traceroute_localhost/active/active/50.20171023161323072695.EMTkwNQ at /usr/share/perl5/IPC/DirQueue.pm line 519. 2017/10/23 14:54:07 (2419) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/10/23 14:54:07 (2419) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/10/23 14:54:07 (2419) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/10/23 15:00:04 (2420) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/10/23 15:00:04 (2420) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) 2017/10/23 15:00:04 (2420) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Can't connect to localhost:80 (connect: Conexão recusada) at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/10/23 15:05:06 (3441) WARN> EsmondBase.pm:207 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data - Error posting data to MA: {"detail":"Time series value already exists with event type path-mtu at time 1508775201"} 2017/10/23 16:18:44 (6762) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Internal Server Error 2017/10/23 16:18:44 (6762) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Internal Server Error 2017/10/23 16:18:44 (6762) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Internal Server Error at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122. 2017/10/23 16:19:28 (7345) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (500) 500 Internal Server Error 2017/10/23 16:19:28 (7345) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: 500 Internal Server Error 2017/10/23 16:19:28 (7345) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 Internal Server Error at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.