perfSONAR User Q&A and Other Discussion

[Zhi-Wei Lu <>]

Hi Andy,

We are getting data now!  Thanks again.

Zhi-Wei Lu
IET-CR-Network Operations Center
University of California, Davis
(530) 752-0155

-----Original Message-----
From: Zhi-Wei Lu 
Sent: Friday, October 10, 2014 8:50 AM
To: 'Andrew Lake'
Subject: RE: [perfsonar-user] perfSonar 3.4x web gui missing in action

Did you mean the following script?

/opt/perfsonar_ps/regular_testing/scripts/regular_testing restart
/opt/perfsonar_ps/regular_testing/scripts/regular_testing stop: perfSONAR 
Regular Testing stopped
waiting...
/opt/perfsonar_ps/regular_testing/bin/daemon 
--config=/opt/perfsonar_ps/regular_testing/etc/regular_testing.conf 
--pidfile=regular_testing.pid --piddir=/var/run 
--logger=/opt/perfsonar_ps/regular_testing/etc/regular_testing-logger.conf 
--user=perfsonar --group=perfsonar --daemonize
/opt/perfsonar_ps/regular_testing/scripts/regular_testing start: perfSONAR 
Regular Testing started

Thanks.

Zhi-Wei Lu
IET-CR-Network Operations Center
University of California, Davis
(530) 752-0155

-----Original Message-----
From: Andrew Lake 
[mailto:]
 
Sent: Friday, October 10, 2014 8:43 AM
To: Zhi-Wei Lu
Subject: Re: [perfsonar-user] perfSonar 3.4x web gui missing in action

Hi,

Replace the three instances of 2728ab24afa33b6d483b365d2d721b4d3040777a with 
212da12c4be05c656f530d58d6416b5ab2ca46c7 then run "/sbin/regular_testing 
restart". That should get rid of the error.

Thanks,
Andy



On Oct 10, 2014, at 11:34 AM, Zhi-Wei Lu 
<>
 wrote:

> The conf file:
>  
> <test>
>     <parameters>
>         packet_length   40
>         receive_only   1
>         test_ipv4_ipv6   1
>         packet_max_ttl   20
>         type   bwtraceroute
>     </parameters>
>     <target>
>         address   pb.noc.ucdavis.edu
>         <override_parameters>
>             type   bwtraceroute
>             force_ipv4   1
>         </override_parameters>
>         description   pb.noc.ucdavis.edu
>     </target>
>     <target>
>         address   p51.noc.ucdavis.edu
>         <override_parameters>
>             type   bwtraceroute
>             force_ipv4   1
>         </override_parameters>
>         description   p51.noc.ucdavis.edu
>     </target>
>     description   Traceroute to UCD
>     <schedule>
>         type   regular_intervals
>         interval   300
>     </schedule>
> </test>
> <test>
>     <parameters>
>         packet_ttl   255
>         packet_length   995
>         receive_only   1
>         test_ipv4_ipv6   1
>         type   bwping
>     </parameters>
>     <target>
>         address   pb.noc.ucdavis.edu
>         <override_parameters>
>             type   bwping
>             force_ipv4   1
>         </override_parameters>
>         description   pb.noc.ucdavis.edu
>     </target>
>     <target>
>         address   p51.noc.ucdavis.edu
>         <override_parameters>
>             type   bwping
>             force_ipv4   1
>         </override_parameters>
>         description   p51.noc.ucdavis.edu
>     </target>
>     <target>
>         address   p0.noc.ucdavis.edu
>         <override_parameters>
>             type   bwping
>             force_ipv4   1
>         </override_parameters>
>         description   p0.noc.ucdavis.edu
>     </target>
>     description   RTD to UCD
>     <schedule>
>         type   regular_intervals
>         interval   300
>     </schedule>
> </test>
> <test>
>     <parameters>
>     <target>
>         address   p51.noc.ucdavis.edu
>         <override_parameters>
>             type   powstream
>             force_ipv4   1
>         </override_parameters>
>         description   UCD p52
>     </target>
>     <target>
>         address   pb.noc.ucdavis.edu
>         <override_parameters>
>             type   powstream
>             force_ipv4   1
>         </override_parameters>
>         description   UCD border
>     </target>
>     description   OWAMP to UCD
>     <schedule>
>         type   streaming
>     </schedule>
> </test>
> test_result_directory   /var/lib/perfsonar/regular_testing
> <measurement_archive>
>     database   http://localhost/esmond/perfsonar/archive/
>     password   2728ab24afa33b6d483b365d2d721b4d3040777a
>     <summary>
>         summary_window   300
>         event_type   packet-loss-rate
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   300
>         event_type   histogram-owdelay
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   300
>         event_type   histogram-owdelay
>         summary_type   statistics
>     </summary>
>     <summary>
>         summary_window   3600
>         event_type   packet-loss-rate
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   3600
>         event_type   histogram-owdelay
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   3600
>         event_type   histogram-owdelay
>         summary_type   statistics
>     </summary>
>     <summary>
>         summary_window   86400
>         event_type   packet-loss-rate
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   86400
>         event_type   histogram-owdelay
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   86400   
>         event_type   histogram-owdelay
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   86400
>         event_type   histogram-rtt
>         summary_type   aggregation
>     </summary>
>     <summary>
>         summary_window   86400
>         event_type   histogram-rtt
>         summary_type   statistics
>     </summary>
>     type   esmond/latency
>     username   perfsonar
> </measurement_archive>
> <measurement_archive>
>     database   http://localhost/esmond/perfsonar/archive/
>     password   2728ab24afa33b6d483b365d2d721b4d3040777a
>     <summary>
>         summary_window   86400
>         event_type   throughput
>         summary_type   average
>     </summary>
>     type   esmond/throughput
>     username   perfsonar
> </measurement_archive>
> <measurement_archive>
>     database   http://localhost/esmond/perfsonar/archive/
>     password   2728ab24afa33b6d483b365d2d721b4d3040777a
>     type   esmond/traceroute
>     username   perfsonar
> </measurement_archive>
>  
>  
>  
> The output of the last command:
> User perfsonar exists
> Setting metadata POST permissions.
> api | ps metadata | Can add ps metadata
> api | ps metadata | Can change ps metadata
> api | ps metadata | Can delete ps metadata
> api | ps point to point subject | Can add ps point to point subject
> api | ps point to point subject | Can change ps point to point subject
> api | ps point to point subject | Can delete ps point to point subject
> api | ps event types | Can add ps event types
> api | ps event types | Can change ps event types
> api | ps event types | Can delete ps event types
> api | ps metadata parameters | Can add ps metadata parameters
> api | ps metadata parameters | Can change ps metadata parameters
> api | ps metadata parameters | Can delete ps metadata parameters
> User perfsonar already has api key, skipping creation
> Key: 212da12c4be05c656f530d58d6416b5ab2ca46c7 for perfsonar
>  
> Zhi-Wei Lu
> IET-CR-Network Operations Center
> University of California, Davis
> (530) 752-0155
>  
> From: Andrew Lake 
> [mailto:]
>  
> Sent: Friday, October 10, 2014 8:17 AM
> To: Zhi-Wei Lu
> Cc: Pulak K Chowdhury
> Subject: Re: [perfsonar-user] perfSonar 3.4x web gui missing in action
>  
> Hi,
>  
> Can you send me the contents of 
> /opt/perfsonar_ps/regular_testing/etc/regular_testing.conf and the output 
> of the last command below:
>  
> cd /opt/esmond
> source /opt/rh/python27/enable
> /opt/rh/python27/root/usr/bin/virtualenv --prompt="(esmond)" .
> . bin/activate
> python esmond/manage.py add_ps_metadata_post_user perfsonar
>  
> Thanks,
> Andy
>  
>  
>  
> On Oct 10, 2014, at 11:10 AM, Zhi-Wei Lu 
> <>
>  wrote:
> 
> 
> Hi Andy,
>  
> We are still getting the same error log (regular_testing.log) and no 
> perfSONAR data.
>  
> 2014/10/10 08:07:42 (4908) WARN> daemon:103 main::__ANON__ - Warned: Use of 
> uninitialized value in pattern match (m//) at 
> /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm
>  line 334.
> 2014/10/10 08:07:42 (4908) DEBUG> EsmondBase.pm:251 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::send_post - 
> Writing to esmond at http://localhost/esmond/perfsonar/archive/
> 2014/10/10 08:07:42 (4908) DEBUG> EsmondBase.pm:252 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::send_post - 
> Esmond request: 
> {"tool-name":"powstream","source":"169.237.246.133","time-probe-interval":0.1,"measurement-agent":"169.237.246.133","destination":"128.120.80.74","ip-transport-protocol":"udp","time-duration":60,"sample-bucket-width":"0.0001","event-types":[{"event-type":"failures"},{"event-type":"packet-count-sent"},{"event-type":"histogram-owdelay","summaries":[{"summary-type":"aggregation","summary-window":"300"},{"summary-type":"statistics","summary-window":"300"},{"summary-type":"aggregation","summary-window":"3600"},{"summary-type":"statistics","summary-window":"3600"},{"summary-type":"aggregation","summary-window":"86400"},{"summary-type":"statistics","summary-window":"86400"},{"summary-type":"statistics","summary-window":"0"}]},{"event-type":"histogram-ttl","summaries":[{"summary-type":"statistics","summary-window":"0"}]},{"event-type":"packet-duplicates"},{"event-type":"packet-loss-rate","summaries":[{"summary-type":"aggregation","summary-window":"300"},{"summary-type":"aggregation","summary-window":"3600"},{"summary-type":"aggregation","summary-window":"86400"}]},{"event-type":"packet-count-lost"},{"event-type":"time-error-estimates"}],"time-interval":0,"subject-type":"point-to-point","input-destination":"p51.noc.ucdavis.edu","sample-size":600,"input-source":"169.237.246.133"}
> 2014/10/10 08:07:42 (4908) DEBUG> EsmondBase.pm:257 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::send_post - 
> Esmond repsonse:
> 2014/10/10 08:07:42 (4908) ERROR> EsmondBase.pm:53 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - 
> Error writing metadata (401) 401 UNAUTHORIZED
> 2014/10/10 08:07:42 (4908) ERROR> MeasurementArchiveChild.pm:209 
> perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results
>  - Problem storing results: Error writing metadata: 401 UNAUTHORIZED
> 2014/10/10 08:07:42 (4908) ERROR> MeasurementArchiveChild.pm:125 
> perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - 
> Problem handling test results: Problem storing results: Error writing 
> metadata: 401 UNAUTHORIZED at 
> /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm
>  line 122.
>  
> Thanks for looking into the problem.
>  
> Zhi-Wei Lu
> IET-CR-Network Operations Center
> University of California, Davis
> (530) 752-0155
>  
> From: 
> 
>  
> [mailto:]
>  On Behalf Of Zhi-Wei Lu
> Sent: Thursday, October 09, 2014 5:04 PM
> To: Andrew Lake
> Cc: 
> ;
>  Pulak K Chowdhury
> Subject: RE: [perfsonar-user] perfSonar 3.4x web gui missing in action
>  
> Thanks Andy!
>  
> The re-configuration has been performed and we will wait a bit to see if we 
> will get any data.
>  
> Thank you.
>  
> Zhi-Wei Lu
> IET-CR-Network Operations Center
> University of California, Davis
> (530) 752-0155
>  
> From: Andrew Lake 
> [mailto:]
>  
> Sent: Thursday, October 09, 2014 1:53 PM
> To: Zhi-Wei Lu
> Cc: 
> ;
>  Pulak K Chowdhury
> Subject: Re: [perfsonar-user] perfSonar 3.4x web gui missing in action
>  
> Hi,
>  
> It might help, looks like maybe the auth credentials are wrong for the 
> regular testing. The following should regenerate them:
>  
> rm -rf /var/lib/pgsql/data/*
> /opt/perfsonar_ps/toolkit/scripts/system_environment/configure_esmond 
> /opt/perfsonar_ps/toolkit/scripts/system_environment/configure_regular_testing
> /etc/init.d/httpd restart
> /etc/init.d/regular_testing start
>  
> Andy
>  
>  
> On Oct 9, 2014, at 4:37 PM, Zhi-Wei Lu 
> <>
>  wrote:
>  
> 
> Hi Andy,
>  
> We were able to get back on track with the GUI by following your recipe, 
> but we are getting problems of storing data, do we need to re-initialize 
> postgres database?
>  
> Here were some errors that we saw on out log file:
>  
> 2014/10/09 13:36:51 (10175) WARN> daemon:103 main::__ANON__ - Warned: Use 
> of uninitialized value in pattern match (m//) at 
> /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm
>  line 334.
> 2014/10/09 13:36:51 (10175) DEBUG> EsmondBase.pm:251 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::send_post - 
> Writing to esmond at http://localhost/esmond/perfsonar/archive/
> 2014/10/09 13:36:51 (10175) DEBUG> EsmondBase.pm:252 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::send_post - 
> Esmond request: 
> {"tool-name":"bwctl/ping","source":"169.237.246.133","time-probe-interval":1,"measurement-agent":"169.237.246.133","destination":"128.120.80.74","ip-ttl":"255","ip-transport-protocol":"icmp","ip-packet-size":"995","event-types":[{"event-type":"failures"},{"event-type":"packet-count-sent"},{"event-type":"histogram-rtt","summaries":[{"summary-type":"aggregation","summary-window":"86400"},{"summary-type":"statistics","summary-window":"86400"},{"summary-type":"statistics","summary-window":"0"}]},{"event-type":"histogram-ttl-reverse"},{"event-type":"packet-duplicates-bidir"},{"event-type":"packet-loss-rate-bidir"},{"event-type":"packet-count-lost-bidir"},{"event-type":"packet-reorders-bidir"}],"time-interval":"300","subject-type":"point-to-point","input-destination":"p51.noc.ucdavis.edu","sample-size":10,"input-source":"169.237.246.133"}
> 2014/10/09 13:36:51 (10175) DEBUG> EsmondBase.pm:257 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::send_post - 
> Esmond repsonse:
> 2014/10/09 13:36:51 (10175) ERROR> EsmondBase.pm:53 
> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - 
> Error writing metadata (401) 401 UNAUTHORIZED
> 2014/10/09 13:36:51 (10175) ERROR> MeasurementArchiveChild.pm:209 
> perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results
>  - Problem storing results: Error writing metadata: 401 UNAUTHORIZED
> 2014/10/09 13:36:51 (10175) ERROR> MeasurementArchiveChild.pm:125 
> perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - 
> Problem handling test results: Problem storing results: Error writing 
> metadata: 401 UNAUTHORIZED at 
> /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm
>  line 122.
>  
> Thank you very much for your help.
>  
> Zhi-Wei Lu
> IET-CR-Network Operations Center
> University of California, Davis
> (530) 752-0155
>  
> From: Andrew Lake 
> [mailto:]
>  
> Sent: Wednesday, October 08, 2014 5:13 PM
> To: Zhi-Wei Lu
> Cc: 
> 
> Subject: Re: [perfsonar-user] perfSonar 3.4x web gui missing in action
>  
> Hi,
>  
> Prior to RC3 (and again when we released RC3) we provided some special 
> upgrade instructions for RC2 users to prevent this. RC2 points at the 
> CentOS SCL repo, which decided to add their own version of 
> python27-mod_wsgi which does not work with the standard apache and 
> overwrites the version we provided.
>  
> No worries though, you should be able to get your host back to normal. Run 
> the following:
>  
> yum remove centos-release-SCL python27-mod_wsgi python27 python27-python 
> httpd24-httpd httpd24-apr httpd24-apr-util httpd24-httpd-tools 
> httpd24-runtime scl-utils
> yum clean all
> rm -rf /var/lib/pgsql/data/*
> yum install perl-perfSONAR_PS-Toolkit 
> perl-perfSONAR_PS-Toolkit-SystemEnvironment
> reboot
>  
> Thanks,
> Andy
>  
>  
> On Oct 8, 2014, at 6:17 PM, Zhi-Wei Lu 
> <>
>  wrote:
> 
> 
> 
> 
> Hi all,
>  
> We have a perfSonar 3.4rc2 test box running. We have recently updated the 
> system and it has those perfSONAR packages:
>  
> perl-perfSONAR-OPPD-MP-Shared-3.4-2.pSPS.noarch
> perl-perfSONAR_PS-Toolkit-3.4-25.pSPS.noarch
> perl-perfSONAR_PS-LSCacheDaemon-3.4-1.pSPS.noarch
> perl-perfSONAR_PS-MeshConfig-Shared-3.4-12.pSPS.noarch
> perl-perfSONAR-OPPD-MP-BWCTL-3.4-2.pSPS.noarch
> perl-perfSONAR_PS-RegularTesting-3.4-15.pSPS.noarch
> perl-perfSONAR_PS-Toolkit-SystemEnvironment-3.4-25.pSPS.noarch
> perl-perfSONAR_PS-SimpleLS-BootStrap-client-3.4-3.pSPS.noarch
> perl-perfSONAR-OPPD-MP-OWAMP-3.4-2.pSPS.noarch
> perl-perfSONAR_PS-serviceTest-3.4-13.pSPS.noarch
> perl-perfSONAR-OPPD-MP-server-3.4-1.pSPS.noarch
> perl-perfSONAR_PS-LSRegistrationDaemon-3.4-2.pSPS.noarch
> perl-perfSONAR_PS-MeshConfig-JSONBuilder-3.4-12.pSPS.noarch
> perl-perfSONAR-OPPD-MP-server-3.4-2.pSPS.noarch
> perl-perfSONAR_PS-MeshConfig-Agent-3.4-12.pSPS.noarch
>  
> The perfsonar daemon appears to be running on the system, but the web GUIS 
> is not
>  
> /etc/init.d/httpd status
> httpd is stopped
>  
> /etc/init.d/httpd start
> Starting httpd: Syntax error on line 1 of 
> /etc/httpd/conf.d/apache-esmond.conf:
> Invalid command 'WSGIScriptAlias', perhaps misspelled or defined by a 
> module not included in the server configuration
>                                                            [FAILED]
>  
> The wsgi modules for the (system) httpd is not installed.  However, I 
> noticed that there is a new package httpd24 along with its own wsgi module, 
> I am able to start the httpd24-httpd daemon, but the familiar toolkit is 
> nowhere to be seen on the web GUI.
>  
> Could someone shed some light on how I suppose get the new perfSONAR going?
>  
> Thank you very much for your help.
>  
> Zhi-Wei Lu
> IET-CR-Network Operations Center
> University of California, Davis
> (530) 752-0155
>