perfSONAR User Q&A and Other Discussion

[Bill Owens <>]

On Mon, Oct 10, 2016 at 09:46:17AM +0000, Garnizov, Ivan (RRZE) wrote:
>    Hi Bill,
> 
>     
> 
>    Please issue “psc debug on” and review the messages in the syslog after a
>    while. Generally it is not a good idea to keep pscheduler in this mode as
>    it is quite “noisy”, but also quite helpful for debugging purposes. You
>    will be able to disable it with “psc debug off”.

Perhaps this is what's breaking?

Oct 11 14:13:31 bss532 journal: scheduler DEBUG    Got 75 rows
Oct 11 14:13:31 bss532 journal: scheduler DEBUG    TASK 
7a6e676c-c382-42e7-bf6e-a7e4cb08428e, 0 runs, try 2016-10-11 14:13:30-04:00
Oct 11 14:13:31 bss532 journal: scheduler DEBUG    Trying to schedule 
7a6e676c-c382-42e7-bf6e-a7e4cb08428e for 2016-10-11 14:13:41.170258-04:00 at 
https://bss532.nysernet.org/pscheduler/tasks/7a6e676c-c382-42e7-bf6e-a7e4cb08428e
Oct 11 14:13:31 bss532 journal: scheduler DEBUG    URL is 
https://bss532.nysernet.org/pscheduler/tasks/7a6e676c-c382-42e7-bf6e-a7e4cb08428e
Oct 11 14:13:31 bss532 journal: scheduler DEBUG    Posting 
https://bss532.nysernet.org/pscheduler/tasks/7a6e676c-c382-42e7-bf6e-a7e4cb08428e
 at 2016-10-11 14:13:41.170258-04:00
Oct 11 14:13:31 bss532 journal: pscheduler-api ERROR    Exception: 
ProgrammingError: column task.cli does not exist#012LINE 15:                  
   task.cli#012                             ^#012#012Traceback (most recent 
call last):#012  File "./pschedulerapiserver/dbcursor.py", line 97, in 
dbcursor_query#012ProgrammingError: column task.cli does not exist#012LINE 
15:                     task.cli#012                             ^
Oct 11 14:13:31 bss532 journal: pscheduler-api ERROR    Exception: 
ProgrammingError: column task.cli does not exist#012LINE 15:                  
   task.cli#012                             ^#012#012Traceback (most recent 
call last):#012  File "./pschedulerapiserver/dbcursor.py", line 97, in 
dbcursor_query#012ProgrammingError: column task.cli does not exist#012LINE 
15:                     task.cli#012                             ^
Oct 11 14:13:31 bss532 journal: pscheduler-api ERROR    Response 500: column 
task.cli does not exist#012LINE 15:                     task.cli#012          
                   ^
Oct 11 14:13:31 bss532 journal: pscheduler-api ERROR    Response 500: column 
task.cli does not exist#012LINE 15:                     task.cli#012          
                   ^
Oct 11 14:13:31 bss532 journal: safe_run/scheduler ERROR    Program threw an 
exception after 0:00:00.309999
Oct 11 14:13:31 bss532 journal: safe_run/scheduler ERROR    Program threw an 
exception after 0:00:00.309999
Oct 11 14:13:31 bss532 journal: safe_run/scheduler ERROR    Exception: 
URLException: 
https://bss532.nysernet.org/pscheduler/tasks/7a6e676c-c382-42e7-bf6e-a7e4cb08428e:
 500: column task.cli does not exist#012LINE 15:                     
task.cli#012                             ^#012#012#012Traceback (most recent 
call last):#012  File 
"/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in 
safe_run#012    function()#012  File 
"/usr/libexec/pscheduler/daemons/scheduler", line 430, in <lambda>#012    
pscheduler.safe_run(lambda: main_program())#012  File 
"/usr/libexec/pscheduler/daemons/scheduler", line 394, in main_program#012    
run_post(url, trynext, log)#012  File 
"/usr/libexec/pscheduler/daemons/scheduler", line 96, in run_post#012    
status, task = pscheduler.url_get(task_url_text, params={'detail': 1})#012  
File "/usr/lib/python2.7/site-packages/pscheduler/psurl.py", line 57, in 
url_get#012    + ": " + text)#012URLException: 
https://bss532.nysernet.org/pscheduler/tasks/7a6e676c-c382-42e7-bf6e-a7e4cb08428e:
 500: column task.cli does not exist#012LINE 15:                     
task.cli#012                             ^
Oct 11 14:13:31 bss532 journal: safe_run/scheduler ERROR    Waiting 414.75 
seconds before restarting
Oct 11 14:13:31 bss532 journal: safe_run/scheduler ERROR    Exception: 
URLException: 
https://bss532.nysernet.org/pscheduler/tasks/7a6e676c-c382-42e7-bf6e-a7e4cb08428e:
 500: column task.cli does not exist#012LINE 15:                     
task.cli#012                             ^#012#012#012Traceback (most recent 
call last):#012  File 
"/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in 
safe_run#012    function()#012  File 
"/usr/libexec/pscheduler/daemons/scheduler", line 430, in <lambda>#012    
pscheduler.safe_run(lambda: main_program())#012  File 
"/usr/libexec/pscheduler/daemons/scheduler", line 394, in main_program#012    
run_post(url, trynext, log)#012  File 
"/usr/libexec/pscheduler/daemons/scheduler", line 96, in run_post#012    
status, task = pscheduler.url_get(task_url_text, params={'detail': 1})#012  
File "/usr/lib/python2.7/site-packages/pscheduler/psurl.py", line 57, in 
url_get#012    + ": " + text)#012URLException: 
https://bss532.nysernet.org/pscheduler/tasks/7a6e676c-c382-42e7-bf6e-a7e4cb08428e:
 500: column task.cli does not exist#012LINE 15:                     
task.cli#012                             ^
Oct 11 14:13:31 bss532 journal: safe_run/scheduler ERROR    Waiting 414.75 
seconds before restarting

I don't know how to interpret those errors, unfortunately. 

Bill.