Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] esmond django.log error - Cassandra

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] esmond django.log error - Cassandra


Chronological Thread 
  • From: Andrew Lake <>
  • To: David Szydloski <>
  • Cc: , Tomasz Kacprzynski <>
  • Subject: Re: [perfsonar-user] esmond django.log error - Cassandra
  • Date: Mon, 8 Jan 2018 08:47:45 -0800
  • Ironport-phdr: 9a23:GCdEPRErRbJVZAYttx8AeJ1GYnF86YWxBRYc798ds5kLTJ78oMSwAkXT6L1XgUPTWs2DsrQY07OQ6/iocFdDyK7JiGoFfp1IWk1NouQttCtkPvS4D1bmJuXhdS0wEZcKflZk+3amLRodQ56mNBXdrXKo8DEdBAj0OxZrKeTpAI7SiNm82/yv95HJbAhEmCexbaluIBmqsA7cqtQYjYx+J6gr1xDHuGFIe+NYxWNpIVKcgRPx7dqu8ZBg7ipdpesv+9ZPXqvmcas4S6dYDCk9PGAu+MLrrxjDQhCR6XYaT24bjwBHAwnB7BH9Q5fxri73vfdz1SWGIcH7S60/VC+85Kl3VhDnlCYHNyY48G7JjMxwkLlbqw+lqxBm3oLYfJ2ZOP94c6jAf90VWHBBU95RWSNDDIOyaIQAAeQCM+hFsYfyu0ADogGiCQS2Hu7i0CNEi33w0KYn0+ohCwbG3Ak4Et8StnTbsc/1O7kcUOuoyqfH1zbDYO1L0jr68ofIdA0uoPGXUL1uasrd008vGB3ZjliJr4HuIj2b1uMIs2eB7upgU/qii3Y5pAFrrDiv3cAsio/TiYIP0FzE8zt2wJozKNalS0B7ecapHIZOuyyZLYd7TNkuTm51tCogyLAKpIa3cDYWxJkj3RLSaPyKf5KW7h79WuudOyp0iXZmdb+5mh2861KvyvfmWcmxyFtKrjRKkt3Ltn0V2Rzc9MeKRuF5/ki63TaDzQ/T6uZaIUwslKrbLYAuwqIom5YOr0jOHTX6lUvsgKKZa0ko4Oql5/n/brXjvJCcNot0ig/kMqQpn8yyGf43Mg4TUGmb4umzyqbj8Vf/QLpUkv06irPZv4zCJcQHuq65BBdY0p495BalATemy9MYnX8dI1JfYR6HkpPpNE/UIP3jCfe/gk+skCtwx/zYJLHhA5PNLmTdn7f7e7Zy9VJcxBQpwd9B+p1UF+JJHPWmdkbvtdCQNQ0oPwiz2OXmQIFxzZEPVWaIGayYGL3TvUSD7+YiZeKLYdlGliz6Lq0M4fL0gGBxvVYecOH91J0beVi1BbJgLlnPMimkucsIDWpf5ll2d+ftklDXFGcLP3s=

Hi,

Cassandra is a java process so all that likely means is cassandra is dying for some reason. Anything in the files under /var/log/cassandra?

Thanks,
Andy



On January 8, 2018 at 11:39:50 AM, David Szydloski () wrote:

Andy,

Maybe that's the problem--I can't kill java / openjdk aren't actually running any processes.

I guess I need to dig in more and see why java's not working on my box.

David

On Mon, Jan 8, 2018 at 9:53 AM, Andrew Lake <> wrote:
Hi,

By chance does your host only have an IPv6 address? It is possible you are hitting the cassandra issue detailed in the FAQ here: http://docs.perfsonar.net/FAQ.html#q-how-can-i-get-cassandra-to-run-on-a-host-that-only-has-an-ipv6-address

You might also might want to try force killing cassandra will “pkill -9 -f java” and then restarting it in case the restart script is not doing what it's supposed to do. 

Thanks,
Andy



On January 8, 2018 at 10:47:52 AM, David Szydloski () wrote:

Hello,

I posted this a little earlier but I wanted to try again:

I'm running perfsonar-toolkit on the following:
OpenStack Nova VM running Ubuntu 16.04
Kernel: 4.4.0-104-generic
perfSONAR version: 4.0.2.1-2~bpo70+1
Toolkit version: same


Here are the errors I'm seeing in /var/log/esmond/django.log
ConnectionException: "System Manager can't connect to Cassandra at localhost:9160 - Could not connect to localhost:9160"
2018-01-07 21:25:33,872 [ERROR] /usr/lib/python2.7/dist-packages/django/core/handlers/base.py: Internal Server Error: /esmond/perfsonar/archive/6cc08a4f976e4041b6fc078c04db3ae4/
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python2.7/dist-packages/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/rest_framework/viewsets.py", line 87, in view
    return self.dispatch(request, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/rest_framework/views.py", line 466, in dispatch
    response = self.handle_exception(exc)
  File "/usr/lib/python2.7/dist-packages/rest_framework/views.py", line 463, in dispatch
    response = handler(request, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/esmond/api/perfsonar/api_v2.py", line 887, in update
    check_connection()
  File "/usr/lib/python2.7/dist-packages/esmond/api/perfsonar/api_v2.py", line 78, in check_connection
    db = CASSANDRA_DB(get_config(get_config_path()))
  File "/usr/lib/python2.7/dist-packages/esmond/cassandra.py", line 134, in __init__
    "at %s - %s" % (config.cassandra_servers[0], e))
ConnectionException: "System Manager can't connect to Cassandra at localhost:9160 - Could not connect to localhost:9160"
I've restarted the cassandra service a few times, yet I don't see the expected port open on localhost. Meanwhile, the cassandra status is showing as being fine. 
There is nothing in /var/log/cassandra at all so that's no help. 
I've seen other suggestions in this mailing list to reinstall esmond (which I've tried since I'm using an Ubuntu system I can't do a simple yum reinstall)
Anyone have any suggestions?

Thanks in advance for your help.

--
David Szydloski
Core Deployment Engineer
VidScale, Inc.



--
David Szydloski
Core Deployment Engineer
VidScale, Inc.



Archive powered by MHonArc 2.6.19.

Top of Page