perfSONAR User Q&A and Other Discussion

[<>]

Hi,

'am a perfSONAR newbie.

We are working with perfSONAR 4.x, attempting to get two VM-based
x86-64/CentOS/toolkit agent installations (no Central Manager) up and running.
After the installations, 'am able to access the agent (local) toolkit WebUI on
one of the agents. 

The UI has the links to the 6 services:
bwctl, lsregistration, meshconfig-agent, owamp, pscheduler & esmond.
but, there is an error message listed under the "Test Results" section, that
says, "Error loading test listing: Internal Server Error"

The esmond service seems to have failed. The esmond log, clean_esmond_db.log,
has the following contents:
cassandra_db [INFO] Checking/creating column families
cassandra_db [INFO] Schema check done
cassandra_db [DEBUG] Opening ConnectionPool
cassandra_db [INFO] Connected to ['localhost:9160']
Error: FATAL:  password authentication failed for user "esmond"

The /var/log/esmond/django.log has the following runtime exception, that
appears to result from a postgres db-access error:
...
    response = handler(request, *args, **kwargs)
  File "/usr/lib/esmond/esmond/api/perfsonar/api_v2.py", line 837, in list
    return super(ArchiveViewset, self).list(request)
  File "/usr/lib/esmond/lib/python2.7/site-packages/rest_framework/mixins.py",
line 41, in list
    page = self.paginate_queryset(queryset)
  File
"/usr/lib/esmond/lib/python2.7/site-packages/rest_framework/generics.py", line
170, in paginate_queryset
    return self.paginator.paginate_queryset(queryset, self.request, view=self)
  File
"/usr/lib/esmond/lib/python2.7/site-packages/rest_framework/pagination.py",
line 395, in paginate_queryset
    self.count = _get_count(queryset)
  File
"/usr/lib/esmond/lib/python2.7/site-packages/rest_framework/pagination.py",
line 50, in _get_count
    return queryset.count()
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/models/query.py", line
318, in count
    return self.query.get_count(using=self.db)
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/models/sql/query.py",
line 466, in get_count
    number = obj.get_aggregation(using, ['__count'])['__count']
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/models/sql/query.py",
line 447, in get_aggregation
    result = compiler.execute_sql(SINGLE)
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/models/sql/compiler.py"
, line 838, in execute_sql
    cursor = self.connection.cursor()
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/backends/base/base.py",
line 164, in cursor
    cursor = self.make_cursor(self._cursor())
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/backends/base/base.py",
line 135, in _cursor
    self.ensure_connection()
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/backends/base/base.py",
line 130, in ensure_connection
    self.connect()
  File "/usr/lib/esmond/lib/python2.7/site-packages/django/db/utils.py", line
97, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/backends/base/base.py",
line 130, in ensure_connection
    self.connect()
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/backends/base/base.py",
line 119, in connect
    self.connection = self.get_new_connection(conn_params)
  File
"/usr/lib/esmond/lib/python2.7/site-packages/django/db/backends/postgresql_psy
copg2/base.py", line 176, in get_new_connection
    connection = Database.connect(**conn_params)
  File "/usr/lib/esmond/lib/python2.7/site-packages/psycopg2/__init__.py",
line 164, in connect
    conn = _connect(dsn, connection_factory=connection_factory, async=async)
OperationalError: FATAL:  password authentication failed for user "esmond"
...

However, the /etc/esmond/esmond.conf file seems to have valid userid/pwd data:
...
[main]
sql_db_engine = django.db.backends.postgresql_psycopg2
sql_db_name = esmond
sql_db_user = esmond
sql_db_password = <some-hash-value-of-an-in-db-pwd-maybe??>
...

Since the esmond service is not up, we seem to be seeing the "Test Results"
section of the toolkit WebUI in an erroredout state.

Any help to debug this issue is greatly appreciated.

thanks,
/venkat