Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] Troubleshooting results

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] Troubleshooting results


Chronological Thread 
  • From: David Szydloski <>
  • To: Valentin Vidic <>, Tomasz Kacprzynski <>
  • Cc:
  • Subject: Re: [perfsonar-user] Troubleshooting results
  • Date: Sun, 7 Jan 2018 15:30:25 -0600
  • Ironport-phdr: 9a23:8AhKMR82Tn+DHP9uRHKM819IXTAuvvDOBiVQ1KB21ugcTK2v8tzYMVDF4r011RmVBdyds6oMotGVmpioYXYH75eFvSJKW713fDhBt/8rmRc9CtWOE0zxIa2iRSU7GMNfSA0tpCnjYgBaF8nkelLdvGC54yIMFRXjLwp1Ifn+FpLPg8it2O2+54Dfbx9UiDahfLh/MAi4oQLNu8cMnIBsMLwxyhzHontJf+RZ22ZlLk+Nkhj/+8m94odt/zxftPw9+cFAV776f7kjQrxDEDsmKWE169b1uhTFUACC+2ETUmQSkhpPHgjF8BT3VYr/vyfmquZw3jSRMNboRr4oRzut86ZrSAfpiCgZMT457HrXgdF0gK5CvR6tuwBzz4vSbYqINvRxY7ndcMsYSmpPXshfWS9PDJ6iYYQTFOcOJ/pUopPnqlcSsRezBw+hD/7vxD9SgX/22LU33eo7HgHY3QwvAs8FvmnVrdT1KagSVee1zLLLzTXCcvhb3iry6JPJcxEhvP6MWbVwcdHSyUkuDA7FkFSQppH+PzyJzOsNt3aU4/B8WuKojm4qsgd8qSWhyMcrj4nGnIMVylbc+Clk3Io5P9y1RUxhbdOnCpdcqS+XO5NqTcw4WWFovjg1yqEctZ67ZigHzoksyR3Ha/GfbYSH+A7vWPqULDtli39oeK6zihO9/ES81uHzSsy530pWoiVZl9TBs24B2hLP5sWBV/Bz5F2u2SyV2ADW8uxEIV47la7cK5M5x74/jJsTsUDaEi74gkX6kLaad0o69uWm9+jreLrmppibN497jgHxLL4ildC4AeQ9KgQOXm6b9vqg1LD740H2WqlGguEzn6XEv53XJdgXq6u2DgNJzoos9xOyACu63NsEmHQKKUxJdRybg4TxPlHBOvH4DfOxg1S2lzdrwujLMaD6ApTMLnnMjbPhfbFm605fyQo+1s5f55NJBbEaPP38QEvxu8LCAhAlNAy0xv7rCM9h2YMGRWKPHqiZPbvKsVCW/OIvLfKMZIgTuDnnMfgp/uPujWQnll8HZqSp2ZoXaGukHvR9PUmVe3vsgtEdEWgUpAo+SvLliEGcXTJJeXm9Qr88tXkHD9eYBIPOQJyshvS/3Su6FdUCWGlCB1aQEHGuSYSIWvwkYyuIJMJ91DweA/zpd4gk3Aq8/CzzwKJ9PPvS4S4Z/cb/19F+//fBhBcp9j1cEcWRyGqES2wylWQNEWwYxqd69GB01FaPmZNqkvBcEsdQ5rsdXhwoJJLYyPd5CvjsWw7add6NRRCtRdDwUmJ5dc4439JbOxU1IN6llB2WmnPyW7I=

Valentin,

Thanks so much for your help.

Here's a snippet of what I'm seeing on https://localhost/esmond/perfsonar/archive:

    {
        "url": "https://10.67.8.23/esmond/perfsonar/archive/5af7d22e85e0461a848de52219cfa7be/",
        "metadata-key": "5af7d22e85e0461a848de52219cfa7be",
        "subject-type": "point-to-point",
        "event-types": [
            {
                "summaries": [],
                "time-updated": null,
                "base-uri": "/esmond/perfsonar/archive/5af7d22e85e0461a848de52219cfa7be/packet-trace/base",
                "event-type": "packet-trace"
            },
            {
                "summaries": [],
                "time-updated": null,
                "base-uri": "/esmond/perfsonar/archive/5af7d22e85e0461a848de52219cfa7be/failures/base",
                "event-type": "failures"
            },
            {
                "summaries": [],
                "time-updated": null,
                "base-uri": "/esmond/perfsonar/archive/5af7d22e85e0461a848de52219cfa7be/path-mtu/base",
                "event-type": "path-mtu"
            },
            {
                "summaries": [],
                "time-updated": null,
                "base-uri": "/esmond/perfsonar/archive/5af7d22e85e0461a848de52219cfa7be/pscheduler-run-href/base",
                "event-type": "pscheduler-run-href"
            }
        ],
        "source": "10.67.8.23",
        "destination": "10.5.8.30",
        "measurement-agent": "10.67.8.23",
        "tool-name": "pscheduler/traceroute",
        "input-source": "10.67.8.23",
        "input-destination": "10.5.8.30",
        "time-duration": "8.0",
        "pscheduler-test-type": "trace",
        "uri": "/esmond/perfsonar/archive/5af7d22e85e0461a848de52219cfa7be/",
        "metadata-count-total": 6,
        "metadata-previous-page": null,
        "metadata-next-page": null
    },
    {
        "url": "https://10.67.8.23/esmond/perfsonar/archive/6cc08a4f976e4041b6fc078c04db3ae4/",
        "metadata-key": "6cc08a4f976e4041b6fc078c04db3ae4",
        "subject-type": "point-to-point",
        "event-types": [],
        "uri": "/esmond/perfsonar/archive/6cc08a4f976e4041b6fc078c04db3ae4/"
    },
    {
        "url": "https://10.67.8.23/esmond/perfsonar/archive/b888965088cd4ac2bc3851e53e59580b/",
        "metadata-key": "b888965088cd4ac2bc3851e53e59580b",
        "subject-type": "point-to-point",
        "event-types": [],
        "uri": "/esmond/perfsonar/archive/b888965088cd4ac2bc3851e53e59580b/"
    },
    {
        "url": "https://10.67.8.23/esmond/perfsonar/archive/c1a5dc096cbd4d5aa01bfc4203dccea9/",
        "metadata-key": "c1a5dc096cbd4d5aa01bfc4203dccea9",
        "subject-type": "point-to-point",
        "event-types": [],
        "uri": "/esmond/perfsonar/archive/c1a5dc096cbd4d5aa01bfc4203dccea9/"
    },
    {
        "url": "https://10.67.8.23/esmond/perfsonar/archive/e1fe2c17166445bca5db41994a4ca353/",
        "metadata-key": "e1fe2c17166445bca5db41994a4ca353",
        "subject-type": "point-to-point",
        "event-types": [],
        "uri": "/esmond/perfsonar/archive/e1fe2c17166445bca5db41994a4ca353/"
    },

I'm not sure if this is expected output or not.

Also, thanks to your suggestion above, I checked the /var/log/esmond/ logs and found a number of errors in django.log (which I thought I had checked before).
ConnectionException: "System Manager can't connect to Cassandra at localhost:9160 - Could not connect to localhost:9160"
2018-01-07 21:25:33,872 [ERROR] /usr/lib/python2.7/dist-packages/django/core/handlers/base.py: Internal Server Error: /esmond/perfsonar/archive/6cc08a4f976e4041b6fc078c04db3ae4/
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python2.7/dist-packages/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/rest_framework/viewsets.py", line 87, in view
    return self.dispatch(request, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/rest_framework/views.py", line 466, in dispatch
    response = self.handle_exception(exc)
  File "/usr/lib/python2.7/dist-packages/rest_framework/views.py", line 463, in dispatch
    response = handler(request, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/esmond/api/perfsonar/api_v2.py", line 887, in update
    check_connection()
  File "/usr/lib/python2.7/dist-packages/esmond/api/perfsonar/api_v2.py", line 78, in check_connection
    db = CASSANDRA_DB(get_config(get_config_path()))
  File "/usr/lib/python2.7/dist-packages/esmond/cassandra.py", line 134, in __init__
    "at %s - %s" % (config.cassandra_servers[0], e))
ConnectionException: "System Manager can't connect to Cassandra at localhost:9160 - Could not connect to localhost:9160"

I've restarted the cassandra service a few times, yet I don't see the expected port open on localhost. Meanwhile, the cassandra status is showing as being fine. 
There is nothing in /var/log/cassandra at all so that's no help. 

Thanks in advance to anyone who can point me in the direction of an answer.

Cheers,

On Sun, Jan 7, 2018 at 10:14 AM, Valentin Vidic <> wrote:
On Sun, Jan 07, 2018 at 09:37:33AM -0600, David Szydloski wrote:
> So far I haven't had much with scouring the logs. Any idea on what else to
> try here would be greatly appreciated.

Can you also check the contents of the esmond archive:

  https://localhost/esmond/perfsonar/archive/

The results should be copied from postgresql to esmond for
archival and than displayed in the graphs.

--
Valentin Vidic
Computer Systems Engineer - Expert
Department of Computer Infrastructure and Services
Croatian Academic and Research Network - CARNET
Josipa Marohnica 5, HR-10000 Zagreb, Croatia
tel: +385 1 6661 714, fax. +385 1 6661 635
gsm: +385 91 2480 919
www.CARNet.hr



--
David Szydloski
Core Deployment Engineer
VidScale, Inc.



Archive powered by MHonArc 2.6.19.

Top of Page