perfSONAR User Q&A and Other Discussion

[Andrew Lake <>]

Hi,

It sounds like you are both  hitting an issue with the page connecting to the lookup service we’ve seen a a number of times where it does not timeout properly. We actually have a fix in 4.0.2 which is in beta and will be out right after the Thanksgiving break for this. You are welcome to try the beta on those machines or you can wait it out two weeks and click past the loading screen in the meantime. I apologize for the inconvenience either way.

Thanks,

Andy

On November 13, 2017 at 7:14:23 PM, Pete Siemsen () wrote:

I have what may be the same problem. For me, it has a simple solution which I didn't stumble on for a while - just click anywhere on the page. The "Loading" disappears. Repeatable, odd, but easy to work around in my case.

-- Pete

On Mon, Nov 13, 2017 at 8:53 AM, Bryan Hess <> wrote:

Yes, I can reach that page-- loads with no problem. Restarting cassandra didn't fix it either, nor did a complete reboot.


esmond.log looks happy:

2017-11-13 10:44:40,092 [INFO] /usr/lib/esmond/esmond/cassandra.py: Connected to ['localhost:9160']
2017-11-13 10:46:35,336 [INFO] /usr/lib/esmond/esmond/cassandra.py: Checking/creating column families
2017-11-13 10:46:35,339 [INFO] /usr/lib/esmond/esmond/cassandra.py: Schema check done
2017-11-13 10:46:35,349 [INFO] /usr/lib/esmond/esmond/cassandra.py: Connected to ['localhost:9160']
2017-11-13 10:46:48,464 [INFO] /usr/lib/esmond/esmond/cassandra.py: Checking/creating column families
2017-11-13 10:46:48,467 [INFO] /usr/lib/esmond/esmond/cassandra.py: Schema check done
2017-11-13 10:46:48,478 [INFO] /usr/lib/esmond/esmond/cassandra.py: Connected to ['localhost:9160']

There was a complaint about cassandra in django.log, but it didn't repeat, so I think this was just during startup:

2017-11-13 10:43:08,481 [ERROR] /usr/lib/esmond/lib/python2.7/site-packages/django/core/handlers/base.py: Internal Server Error: /esmond/perfsonar/archive/
Traceback (most recent call last):
  File "/usr/lib/esmond/lib/python2.7/site-packages/django/core/handlers/base.py", line 119, in get_response
    resolver_match = resolver.resolve(request.path_info)
  File "/usr/lib/esmond/lib/python2.7/site-packages/django/core/urlresolvers.py", line 365, in resolve
    for pattern in self.url_patterns:
  File "/usr/lib/esmond/lib/python2.7/site-packages/django/core/urlresolvers.py", line 401, in url_patterns
    patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
  File "/usr/lib/esmond/lib/python2.7/site-packages/django/core/urlresolvers.py", line 395, in urlconf_module
    self._urlconf_module = import_module(self.urlconf_name)
  File "/usr/lib64/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
  File "/usr/lib/esmond/esmond/urls.py", line 27, in <module>
    from esmond.api.perfsonar.api_v2 import (
  File "/usr/lib/esmond/esmond/api/perfsonar/api_v2.py", line 65, in <module>
    raise ConnectionException(error_msg)
ConnectionException: 'Unable to connect to cassandra. Please verify cassandra is running.'



Cassandra seems to be running:

$ ps -ef | grep cassandra
cassand+  3309     1 18 10:43 ?        00:01:41 java -ea -javaagent:/usr/share/cassandra/lib/jamm-0.2.5.jar -XX:+CMSClassUnloadingEnabled -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -Xms1955M -Xmx1955M -Xmn488M -XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseTLAB -XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways -XX:+UseCondCardMark -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199 -XX:+DisableExplicitGC -Dlog4j.configuration=log4j-server.properties -Dlog4j.defaultInitOverride=true -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp /etc/cassandra/conf:/usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/apache-cassandra-2.0.17.jar:/usr/share/cassandra/lib/apache-cassandra-clientutil-2.0.17.jar:/usr/share/cassandra/lib/apache-cassandra-thrift-2.0.17.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.3.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/guava-15.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jline-1.0.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.1.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/lz4-1.2.0.jar:/usr/share/cassandra/lib/metrics-core-2.2.0.jar:/usr/share/cassandra/lib/netty-3.6.6.Final.jar:/usr/share/cassandra/lib/reporter-config-2.1.0.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.7.2.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.7.2.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.0.5.jar:/usr/share/cassandra/lib/snaptree-0.1.jar:/usr/share/cassandra/lib/stress.jar:/usr/share/cassandra/lib/super-csv-2.1.0.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar org.apache.cassandra.service.CassandraDaemon
admin     9236  5002  0 10:52 pts/0    00:00:00 grep --color=auto cassandra

----- Original Message -----
From: "Andrew Lake" <>
To: "Trond Endrestøl" <>, "Bryan Hess" <>
Cc: "perfsonar-user" <>
Sent: Monday, November 13, 2017 10:15:21 AM
Subject: Re: [perfsonar-user] tests.cgi page stuck at loading

Hi,

Can you reach "https://<hostname>/esmond/perfsonar/archive/?limit=1”? You
may want to try restarting cassandra (systemctl restart cassandra). My
guess is that its hanging trying to connect to esmond. You can look for
errors in the logs under /var/log/esmond to verify.

Thanks,
Andy



On November 13, 2017 at 10:07:35 AM, Bryan Hess () wrote:


No, IPv4.


----- Original Message -----
From: "Trond Endrestøl" <>
To: "perfsonar-user" <>
Sent: Monday, November 13, 2017 10:02:08 AM
Subject: Re: [perfsonar-user] tests.cgi page stuck at loading

On Mon, 13 Nov 2017 09:26-0500, Bryan Hess wrote:

> Thanks for any pointers.

Are you accessing the web UI by an IPv6 connection?

--
Trond.