perfSONAR User Q&A and Other Discussion

[Daniel Manzo <>]

Hi Andy,

 

The response I get from “pscheduler internal db-update” is:

 

Loading database:

    Administrative...This account is currently not available.

 

I tried using “yum reinstall pscheduler-server”, but that ended up resulting in getting an access error, “Exception: OperationalError: FATAL:  password authentication failed for user "pscheduler"”. I then changed the password of pscheduler by entering “sudo –u postgres psql” and then running the command “ALTER USER “pscheduler” WITH PASSWORD ‘<whateverwasindatabase-password>’;” After changing the password for pscheduler, I didn’t get the password authentication error, but I then got the same errors as below. Am I doing something wrong when changing the psql password? Thanks again for the help.

 

Dan Manzo

 

From: Andrew Lake [mailto:]
Sent: Monday, June 19, 2017 12:52 PM
To: perfsonar-user; Daniel Manzo
Subject: Re: [perfsonar-user] pscheduler problems

 

Hi,

 

Looks like your pscheduler database is not setup properly. You can try running the command "pscheduler internal db-update” to see if that fixes things or possibly gives any useful errors. . The tables usually get setup when the pscheduler-server package is installed so “yum reinstall pscheduler-server” is another way to trigger the same process, but sounds like you tried that already. 

 

Andy

 

 

On June 19, 2017 at 11:38:55 AM, Daniel Manzo () wrote:

Hi all,

 

I am currently running perfSONAR v4.0 on RHEL 7.3. I was previously having problems with postgresql-9.5, but now those are resolved. However, now I am having different errors with the pscheduler services.

 

Here is what is reported when running “sudo systemctl status pscheduler-archiver –l”:

 

Jun 19 11:25:38 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Restarting

Jun 19 11:25:38 by0ok5.na.bayer.cnb archiver[31896]: archiver ERROR    Failed to delete defaults: relation "archive_default" does not exist

                                                     LINE 1: DELETE FROM archive_default

                                                                         ^

Jun 19 11:25:38 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Program threw an exception after 0:00:00.004839

Jun 19 11:25:38 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Exception: ProgrammingError: function archiving_next(integer) does not exist

                                                     LINE 5:                              FROM archiving_next(15)

                                                                                               ^

                                                     HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

 

                                                     Traceback (most recent call last):

                                                       File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                         function()

                                                       File "/usr/libexec/pscheduler/daemons/archiver", line 522, in <lambda>

                                                         pscheduler.safe_run(lambda: main_program())

                                                       File "/usr/libexec/pscheduler/daemons/archiver", line 478, in main_program

                                                         [options.max_parallel])

                                                       File "/usr/lib/python2.7/site-packages/pscheduler/db.py", line 197, in query

                                                         cursor.execute(query, args)

                                                     ProgrammingError: function archiving_next(integer) does not exist

                                                     LINE 5:                              FROM archiving_next(15)

                                                                                               ^

                                                     HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:25:38 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Waiting 16.5 seconds before restarting

Jun 19 11:25:55 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Restarting

Jun 19 11:25:55 by0ok5.na.bayer.cnb archiver[31896]: archiver ERROR    Failed to delete defaults: relation "archive_default" does not exist

                                                     LINE 1: DELETE FROM archive_default

                                                                         ^

Jun 19 11:25:55 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Program threw an exception after 0:00:00.005056

Jun 19 11:25:55 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Exception: ProgrammingError: function archiving_next(integer) does not exist

                                                     LINE 5:                              FROM archiving_next(15)

                                                                                               ^

                                                     HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

 

                                                     Traceback (most recent call last):

                                                       File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                         function()

                                                       File "/usr/libexec/pscheduler/daemons/archiver", line 522, in <lambda>

                                                         pscheduler.safe_run(lambda: main_program())

                                                       File "/usr/libexec/pscheduler/daemons/archiver", line 478, in main_program

                                                         [options.max_parallel])

                                                       File "/usr/lib/python2.7/site-packages/pscheduler/db.py", line 197, in query

                                                         cursor.execute(query, args)

                                                     ProgrammingError: function archiving_next(integer) does not exist

                                                     LINE 5:                              FROM archiving_next(15)

                                                                                               ^

                                                     HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:25:55 by0ok5.na.bayer.cnb archiver[31896]: safe_run/archiver ERROR    Waiting 16.75 seconds before restarting

 

Here is what is reported when running “sudo systemctl status pscheduler-runner –l”:

 

Jun 19 11:30:32 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Exception: ProgrammingError: relation "run" does not exist

                                                   LINE 11:                            run

                                                                                       ^

 

                                                   Traceback (most recent call last):

                                                     File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                       function()

                                                     File "/usr/libexec/pscheduler/daemons/runner", line 907, in <lambda>

                                                       pscheduler.safe_run(lambda: main_program())

                                                     File "/usr/libexec/pscheduler/daemons/runner", line 817, in main_program

                                                       """, [refresh]);

                                                   ProgrammingError: relation "run" does not exist

                                                   LINE 11:                            run

                                                                                       ^

Jun 19 11:30:32 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Waiting 20.5 seconds before restarting

Jun 19 11:30:53 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Restarting

Jun 19 11:30:53 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Program threw an exception after 0:00:00.002882

Jun 19 11:30:53 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Exception: ProgrammingError: relation "run" does not exist

                                                   LINE 11:                            run

                                                                                       ^

 

                                                   Traceback (most recent call last):

                                                     File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                       function()

                                                     File "/usr/libexec/pscheduler/daemons/runner", line 907, in <lambda>

                                                       pscheduler.safe_run(lambda: main_program())

                                                     File "/usr/libexec/pscheduler/daemons/runner", line 817, in main_program

                                                       """, [refresh]);

                                                   ProgrammingError: relation "run" does not exist

                                                   LINE 11:                            run

                                                                                       ^

Jun 19 11:30:53 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Waiting 20.75 seconds before restarting

Jun 19 11:31:14 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Restarting

Jun 19 11:31:14 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Program threw an exception after 0:00:00.002955

Jun 19 11:31:14 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Exception: ProgrammingError: relation "run" does not exist

                                                   LINE 11:                            run

                                                                                       ^

 

                                                   Traceback (most recent call last):

                                                     File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                       function()

                                                     File "/usr/libexec/pscheduler/daemons/runner", line 907, in <lambda>

                                                       pscheduler.safe_run(lambda: main_program())

                                                     File "/usr/libexec/pscheduler/daemons/runner", line 817, in main_program

                                                       """, [refresh]);

                                                   ProgrammingError: relation "run" does not exist

                                                   LINE 11:                            run

                                                                                       ^

Jun 19 11:31:14 by0ok5.na.bayer.cnb runner[31871]: safe_run/runner ERROR    Waiting 21.0 seconds before restarting

 

Here is what is reported when running “sudo systemctl status pscheduler-scheduler –l”:

 

Jun 19 11:31:35 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Exception: ProgrammingError: relation "schedule_runs_to_schedule" does not exist

                                                      LINE 3:             FROM schedule_runs_to_schedule LIMIT 1

                                                                               ^

 

                                                      Traceback (most recent call last):

                                                        File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                          function()

                                                        File "/usr/libexec/pscheduler/daemons/scheduler", line 662, in <lambda>

                                                          pscheduler.safe_run(lambda: main_program())

                                                        File "/usr/libexec/pscheduler/daemons/scheduler", line 548, in main_program

                                                          """)

                                                      ProgrammingError: relation "schedule_runs_to_schedule" does not exist

                                                      LINE 3:             FROM schedule_runs_to_schedule LIMIT 1

                                                                               ^

Jun 19 11:31:35 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Waiting 21.25 seconds before restarting

Jun 19 11:31:56 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Restarting

Jun 19 11:31:56 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Program threw an exception after 0:00:00.003653

Jun 19 11:31:56 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Exception: ProgrammingError: relation "schedule_runs_to_schedule" does not exist

                                                      LINE 3:             FROM schedule_runs_to_schedule LIMIT 1

                                                                               ^

 

                                                      Traceback (most recent call last):

                                                        File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                          function()

                                                        File "/usr/libexec/pscheduler/daemons/scheduler", line 662, in <lambda>

                                                          pscheduler.safe_run(lambda: main_program())

                                                        File "/usr/libexec/pscheduler/daemons/scheduler", line 548, in main_program

                                                          """)

                                                      ProgrammingError: relation "schedule_runs_to_schedule" does not exist

                                                      LINE 3:             FROM schedule_runs_to_schedule LIMIT 1

                                                                               ^

Jun 19 11:31:56 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Waiting 21.5 seconds before restarting

Jun 19 11:32:17 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Restarting

Jun 19 11:32:17 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Program threw an exception after 0:00:00.002758

Jun 19 11:32:17 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Exception: ProgrammingError: relation "schedule_runs_to_schedule" does not exist

                                                      LINE 3:             FROM schedule_runs_to_schedule LIMIT 1

                                                                               ^

 

                                                      Traceback (most recent call last):

                                                        File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                          function()

                                                        File "/usr/libexec/pscheduler/daemons/scheduler", line 662, in <lambda>

                                                          pscheduler.safe_run(lambda: main_program())

                                                        File "/usr/libexec/pscheduler/daemons/scheduler", line 548, in main_program

                                                          """)

                                                      ProgrammingError: relation "schedule_runs_to_schedule" does not exist

                                                      LINE 3:             FROM schedule_runs_to_schedule LIMIT 1

                                                                               ^

Jun 19 11:32:17 by0ok5.na.bayer.cnb scheduler[31846]: safe_run/scheduler ERROR    Waiting 21.75 seconds before restarting

 

Here is what is reported when running “sudo systemctl status pscheduler-ticker –l”:

 

Jun 19 11:33:02 by0ok5.na.bayer.cnb ticker[32350]: ticker WARNING  Queue maintainer got exception function http_queue_process_all() does not exist

                                                   LINE 1: SELECT http_queue_process_all()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:33:02 by0ok5.na.bayer.cnb ticker[32350]: ticker WARNING  Queue maintainer got exception function http_queue_process_all() does not exist

                                                   LINE 1: SELECT http_queue_process_all()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:33:02 by0ok5.na.bayer.cnb ticker[32350]: ticker WARNING  Queue maintainer got exception function http_queue_process_all() does not exist

                                                   LINE 1: SELECT http_queue_process_all()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:33:02 by0ok5.na.bayer.cnb ticker[32350]: ticker WARNING  Queue maintainer got exception function http_queue_process_all() does not exist

                                                   LINE 1: SELECT http_queue_process_all()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:33:02 by0ok5.na.bayer.cnb ticker[32350]: ticker WARNING  Queue maintainer got exception function http_queue_process_all() does not exist

                                                   LINE 1: SELECT http_queue_process_all()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:33:02 by0ok5.na.bayer.cnb ticker[32350]: ticker WARNING  Queue maintainer got exception function http_queue_process_all() does not exist

                                                   LINE 1: SELECT http_queue_process_all()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:33:05 by0ok5.na.bayer.cnb ticker[32350]: safe_run/ticker ERROR    Restarting

Jun 19 11:33:05 by0ok5.na.bayer.cnb ticker[32350]: safe_run/ticker ERROR    Program threw an exception after 0:00:00.003517

Jun 19 11:33:05 by0ok5.na.bayer.cnb ticker[32350]: safe_run/ticker ERROR    Exception: ProgrammingError: function cold_boot() does not exist

                                                   LINE 1: SELECT cold_boot()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

 

                                                   Traceback (most recent call last):

                                                     File "/usr/lib/python2.7/site-packages/pscheduler/saferun.py", line 41, in safe_run

                                                       function()

                                                     File "/usr/libexec/pscheduler/daemons/ticker", line 153, in <lambda>

                                                       pscheduler.safe_run(lambda: main_program())

                                                     File "/usr/libexec/pscheduler/daemons/ticker", line 127, in main_program

                                                       cursor.execute("SELECT cold_boot()")

                                                   ProgrammingError: function cold_boot() does not exist

                                                   LINE 1: SELECT cold_boot()

                                                                  ^

                                                   HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

Jun 19 11:33:05 by0ok5.na.bayer.cnb ticker[32350]: safe_run/ticker ERROR    Waiting 21.25 seconds before restarting

 

So far, I have tried removing the pscheduler and perfsonar packages and then re-installing via yum. I have also tried just removing pscheduler packages and re-installing via yum. Not sure, what to do about these errors, so any and all help is appreciated.

 

Thanks,

Dan Manzo