perfSONAR User Q&A and Other Discussion

[David Szydloski <>]

Andy,

Nope, there's nothing in that directory. I'm even getting errors just trying to run sudo cassandra from the cli. So it looks like there is some underlying java issue here--though I don't know why the service would look okay in this state:

dszydloski@netperf01-lon1:~$ sudo systemctl status cassandra

sudo: unable to resolve host netperf01-lon1

● cassandra.service - LSB: distributed storage system for structured data

   Loaded: loaded (/etc/init.d/cassandra; bad; vendor preset: enabled)

   Active: active (exited) since Mon 2018-01-08 16:45:31 UTC; 11min ago

     Docs: man:systemd-sysv-generator(8)

  Process: 1369 ExecStart=/etc/init.d/cassandra start (code=exited, status=0/SUCCESS)

Jan 08 16:45:29 netperf01-lon1 systemd[1]: Starting LSB: distributed storage system for structured data...

Jan 08 16:45:31 netperf01-lon1 systemd[1]: Started LSB: distributed storage system for structured data.

David

On Mon, Jan 8, 2018 at 10:47 AM, Andrew Lake <> wrote:

Hi,

Cassandra is a java process so all that likely means is cassandra is dying for some reason. Anything in the files under /var/log/cassandra?

Thanks,

Andy

On January 8, 2018 at 11:39:50 AM, David Szydloski () wrote:

Andy,

Maybe that's the problem--I can't kill java / openjdk aren't actually running any processes.

I guess I need to dig in more and see why java's not working on my box.

David

On Mon, Jan 8, 2018 at 9:53 AM, Andrew Lake <> wrote:

Hi,

By chance does your host only have an IPv6 address? It is possible you are hitting the cassandra issue detailed in the FAQ here: http://docs.perfsonar.net/FAQ.html#q-how-can-i-get-cassandra-to-run-on-a-host-that-only-has-an-ipv6-address

You might also might want to try force killing cassandra will “pkill -9 -f java” and then restarting it in case the restart script is not doing what it's supposed to do. 

Thanks,

Andy

On January 8, 2018 at 10:47:52 AM, David Szydloski () wrote:

Hello,

I posted this a little earlier but I wanted to try again:

I'm running perfsonar-toolkit on the following:

OpenStack Nova VM running Ubuntu 16.04

Kernel: 4.4.0-104-generic

perfSONAR version: 4.0.2.1-2~bpo70+1

Toolkit version: same

Here are the errors I'm seeing in /var/log/esmond/django.log

ConnectionException: "System Manager can't connect to Cassandra at localhost:9160 - Could not connect to localhost:9160"
2018-01-07 21:25:33,872 [ERROR] /usr/lib/python2.7/dist-packages/django/core/handlers/base.py: Internal Server Error: /esmond/perfsonar/archive/6cc08a4f976e4041b6fc078c04db3ae4/
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python2.7/dist-packages/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/rest_framework/viewsets.py", line 87, in view
    return self.dispatch(request, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/rest_framework/views.py", line 466, in dispatch
    response = self.handle_exception(exc)
  File "/usr/lib/python2.7/dist-packages/rest_framework/views.py", line 463, in dispatch
    response = handler(request, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/esmond/api/perfsonar/api_v2.py", line 887, in update
    check_connection()
  File "/usr/lib/python2.7/dist-packages/esmond/api/perfsonar/api_v2.py", line 78, in check_connection
    db = CASSANDRA_DB(get_config(get_config_path()))
  File "/usr/lib/python2.7/dist-packages/esmond/cassandra.py", line 134, in __init__
    "at %s - %s" % (config.cassandra_servers[0], e))
ConnectionException: "System Manager can't connect to Cassandra at localhost:9160 - Could not connect to localhost:9160"

I've restarted the cassandra service a few times, yet I don't see the expected port open on localhost. Meanwhile, the cassandra status is showing as being fine. 

There is nothing in /var/log/cassandra at all so that's no help. 

I've seen other suggestions in this mailing list to reinstall esmond (which I've tried since I'm using an Ubuntu system I can't do a simple yum reinstall)

Anyone have any suggestions?

Thanks in advance for your help.

--

David Szydloski

Core Deployment Engineer

VidScale, Inc.

--

David Szydloski

Core Deployment Engineer

VidScale, Inc.

--

David Szydloski

Core Deployment Engineer

VidScale, Inc.