perfSONAR User Q&A and Other Discussion

[Zhi-Wei Lu <>]

Hi all,

 

I have found the reason of failure.  My box was upgraded to 4.0rc1, the upgrade was probably not successful.

 

This box was from UCOP with perfsonar pre-installed.  I put it into production without realizing that it has

Internet2-staging.repo ENABLED. 

 

How can I restore the old perfsonar 3.5.1?  I do have data backups.

 

Thank you.

 

Zhi-Wei Lu

IET-CR-Network Operations Center

University of California, Davis

(530) 752-0155

 

From: Zhi-Wei Lu
Sent: Friday, September 23, 2016 9:59 AM
To: Zhi-Wei Lu <>; perfsonar-user <>
Subject: RE: [perfsonar-user] "Test Results" not loading on perfSONAR toolkit homepage

 

Hi all,

 

I am looking at the problem, I found that problem started on Sept. 14 after update.

 

/etc/init.d/perfsonar-psb_to_esmond failed to load properly, it failed to obtain MA_KEY from this command,

 

MA_KEY=`python esmond/manage.py add_api_key_user perfsonar | grep "Key:" | cut -f2 -d " "`

 

The python trace show Esmond password issue:

….

 

File "/usr/lib/esmond/lib/python2.7/site-packages/psycopg2/__init__.py", line 164, in connect

    conn = _connect(dsn, connection_factory=connection_factory, async=async)

django.db.utils.OperationalError: FATAL:  password authentication failed for user "esmond"

 

I wonder how I can check/set/reset Esmond password?

 

Thank you.

 

Zhi-Wei Lu

IET-CR-Network Operations Center

University of California, Davis

(530) 752-0155

 

From: [] On Behalf Of Zhi-Wei Lu
Sent: Thursday, September 22, 2016 8:45 AM
To: Andrew Lake <>; Kathy Benninger <>; perfsonar-user <>
Subject: RE: [perfsonar-user] "Test Results" not loading on perfSONAR toolkit homepage

 

Hi Andy,

 

We are experiencing problem on one of our (busy) servers as well.  We are getting:

Error loading test listing: Internal Server Error

 

When I try to load the two archive pages, I am getting: Server Error (500)

 

On the log file “regulartesting.log”, I saw

2016/09/14 03:30:39 (29034) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: 500 INTERNAL SERVER ERROR at /usr/lib/perfsonar/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.

 

It appears to me that the Esmond database is somehome corrupted.  What can I do to repair the database?  Shall I remove some old data?

 

Thank you.

 

Zhi-Wei Lu

IET-CR-Network Operations Center

University of California, Davis

(530) 752-0155

 

From: [] On Behalf Of Andrew Lake
Sent: Friday, September 02, 2016 8:55 AM
To: Kathy Benninger <>; perfsonar-user <>
Subject: Re: [perfsonar-user] "Test Results" not loading on perfSONAR toolkit homepage

 

Hi Kathy,

 

Try opening the following in your web browser:

 

http://<your-host>/esmond/perfsonar/archive?limit=1

http://<your-host>/esmond/perfsonar/archive?time-range=86400

 

Do either of those timeout? Also, is the host running a lot of tests? It may just be that the display is having trouble getting all the results in a reasonable amount of time as it not only gets the test listing, but also grabs a bunch of results to  generate the summary columns. In the forthcoming 4.0 we re-worked some of this, so it should behave better if that is indeed the case (not that it does you a lot of good in the immediate term). 

 

Thanks,

Andy

 

On September 2, 2016 at 11:46:41 AM, Kathy Benninger () wrote:

I admin a perfSONAR that recently stopped loading "Test Results" on its
homepage. The general perfSONAR information and the "Services" section come
up just fine. It looks like it's thinking really hard about "Loading Tests"
but it times out after ~1min 20sec and says:

"Error loading test listing: Gateway Time-out".

Regular testing is running and the local MA is collecting results because
when I access its tests via the XSEDE maddash, recent test results are there
and look fine.

What should I check?

Kathy