perfSONAR User Q&A and Other Discussion

[Colin Domansky <>]

Hi Brian,

While troubleshooting yesterday, I was comparing the  /etc/perfsonar/regulartesting.conf file between 2 Full ISO Servers I had.  I could not see exactly what the difference was, but I had a feeling that it was corrupted.  

Because I was not very far with implementing perfSonar within my infrastructure, decision was made to delete my VM's, document the install process, as well as backing up configuration files at regular intervals to minimize this from happening again.  

If I do run into this again, I will post so that issue is properly documented.

Thanks,

Colin

On Tue, Jul 19, 2016 at 12:06 PM Brian Tierney <> wrote:

based on this: "ERROR> regulartesting.pl:84 main:: - Problem parsing configuration file: Line 12 malformed"

Looks like something corrupted your config file.

Can you send us /etc/perfsonar/regulartesting.conf

On Mon, Jul 18, 2016 at 2:08 PM, <> wrote:

Hi,

While adding One-Way Latency Test within the UI, I noticed that the Regular
Testing service had stopped working.  While checking the log file
/var/log/perfsonar/regulartesting.log  I came across these errors.


2016/07/13 15:34:27 (7159) WARN> regulartesting.pl:103 main::__ANON__ -
Warned: IPC::DirQueue: killed stale lockfile:
/var/lib/perfsonar/regulartesting/esmond_traceroute_localhost/active/active/50
.20160713202132108188.EMj4NQ at /usr/share/perl5/IPC/DirQueue.pm line 519.
2016/07/13 15:34:27 (7163) WARN> EsmondBase.pm:207
perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::add_data -
Error posting data to MA: {"detail":"Time series value already exists with
event type path-mtu at time 1468441288"}
2016/07/18 06:35:24 (18507) WARN> regulartesting.pl:103 main::__ANON__ -
Warned: Use of uninitialized value in concatenation (.) or string at
/usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/
EsmondTraceroute.pm line 37.
2016/07/18 12:00:12 (26449) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/powstream -4 -p -d
/var/lib/perfsonar/regulartesting/owamp_f7Ngp -c 600 -i 0.1 -P 8760-9960
Borden
2016/07/18 12:00:12 (26450) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/bwtraceroute -c 10.5.5.250 -T
tracepath,traceroute -4 -I 600 -p -d
/var/lib/perfsonar/regulartesting/bwctl_RKwP7 -v -y a -E
2016/07/18 12:00:12 (26449) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/powstream -4 -p -d
/var/lib/perfsonar/regulartesting/owamp_rcQWj -c 600 -i 0.1 -P 8760-9960 -t
Borden
2016/07/18 12:00:12 (26450) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/bwtraceroute -c Borden -T
tracepath,traceroute -4 -I 600 -p -d
/var/lib/perfsonar/regulartesting/bwctl_imzN1 -v -y a -E
2016/07/18 12:00:12 (26451) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/bwctl -s eth0 -c 10.5.5.250 -T iperf3,iperf
-B eth0 -4 -I 21600 -p -d /var/lib/perfsonar/regulartesting/bwctl_6pw8w -v -P
1 -t 20 -i 1 --parsable
2016/07/18 12:00:12 (26451) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/bwctl -s 10.5.5.250 -c eth0 -T iperf3,iperf
-B eth0 -4 -I 21600 -p -d /var/lib/perfsonar/regulartesting/bwctl_IYPa9 -v -P
1 -t 20 -i 1 --parsable
2016/07/18 12:00:12 (26450) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/bwtraceroute -c 10.5.5.250 -T
tracepath,traceroute -4 -I 600 -p -d
/var/lib/perfsonar/regulartesting/bwctl_4buNI -v -y a -E
2016/07/18 12:00:12 (26454) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/bwctl -c 10.45.5.250 -T iperf3,iperf -4 -I
21600 -p -d /var/lib/perfsonar/regulartesting/bwctl_z4NMG -v -P 1 -t 20 -i 1
--parsable
2016/07/18 12:00:12 (26454) ERROR> CmdRunner.pm:148
perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Command exited, will
restart in 298 seconds : /usr/bin/bwctl -s 10.45.5.250 -T iperf3,iperf -4 -I
21600 -p -d /var/lib/perfsonar/regulartesting/bwctl_g1aw_ -v -P 1 -t 20 -i 1
--parsable
2016/07/18 12:04:54 (27175) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 12:04:54 (27175) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 13:00:17 (30432) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 13:00:17 (30432) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 13:14:30 (1961) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 13:14:30 (1961) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 14:00:18 (4793) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 14:00:18 (4793) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 14:41:43 (6053) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 14:41:43 (6053) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 14:50:15 (6286) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 14:50:15 (6286) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 14:53:40 (6432) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 14:53:40 (6432) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 14:56:39 (6550) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 14:56:39 (6550) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 14:57:40 (6565) ERROR> ConfigFile.pm:39
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Couldn't open
/etc/perfsonar/regulartesting.conf
2016/07/18 14:57:40 (6565) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Couldn't open /etc/perfsonar/regulartesting.conf
2016/07/18 15:12:54 (7109) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 15:12:54 (7109) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 15:50:56 (7551) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 15:50:56 (7551) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed
2016/07/18 15:51:04 (7563) ERROR> ConfigFile.pm:101
perfSONAR_PS::RegularTesting::Utils::ConfigFile::parse_file - Line 12
malformed
2016/07/18 15:51:04 (7563) ERROR> regulartesting.pl:84 main:: - Problem
parsing configuration file: Line 12 malformed

Any thoughts on what could be causing this ?

Regards,
Colin

--

Brian Tierney, http://www.es.net/tierney
Energy Sciences Network (ESnet), Berkeley National Lab
http://fasterdata.es.net