perfSONAR User Q&A and Other Discussion

[Johann Hugo <>]

Hi all 

Pscheduler seems to be stuck on one of my servers, with no test data in maddash.

pscheduler monitor only shows some old tasks that are finished, but no new ones.

2020-11-11T10:22:46+02:00      Finished     latencybg --source ps-6-jnb-wits-10g.perfsonar.ac.za --source-node ps-6-jnb-wits-10g.perfsonar.ac.za --dest

Pscheduler ping works:

ps-6.perfsonar.ac.za: pScheduler is alive

 

Esmond web page https://ps-6-jnb-wits-10g.perfsonar.ac.za/esmond/perfsonar/archive/ shows some test results, but it might be old data.

[root@ps-6-jnb-wits log]# pscheduler troubleshoot
Performing basic troubleshooting of localhost.
localhost:
  Measuring MTU... 65535 (Local)
  Looking for pScheduler... OK.
  Fetching API level... 4
  Checking clock... OK.
  Exercising API... Status... Tests... Tools... OK.
  Fetching service status... OK.
  Checking services... ticker... scheduler... runner... archiver... OK.
  Idle test.... 9 seconds.... Checking archiving... OK.
pScheduler appears to be functioning normally.

psconfig pscheduler-stats shows there are 28 tasks from the remote URL

Agent Last Run Start Time: 2020/11/11 12:43:20
Agent Last Run End Time: 2020/11/11 12:43:51
Agent Last Run Process ID (PID): 2469
Agent Last Run Log GUID: B7250986-240A-11EB-BA47-5A4FE1D7170D
Total tasks managed by agent: 28
From remote definitions: 28
    http://perf-pwa.sanren.ac.za/pub/config/sanren_mesh_2019.json: 28

No errors in:

/var/log/pscheduler/pscheduler.log

/var/log/esmond/esmond.log

esmond is listening on port 9160

The last issue (couple of days ago) in /var/log/esmond/django.log

2020-11-09 03:35:18,745 [WARNING] /usr/lib/esmond/lib/python3.6/site-packages/django/core/handlers/base.py: Not Found: /esmond/perfsonar/archive/?event-type=histogram-owdelay&limit=1/

I've tried to reconfigure esmond:

/usr/lib/perfsonar/scripts/system_environment/configure_esmond --force

I've also tried to reinstall esmond.x86_64 and pscheduler-server, but still no new test results.

A reboot of the server made no difference. 

Any ideas where I can look for the problem ?

Regards

Johann