perfSONAR User Q&A and Other Discussion

["Pennington, Michael" <>]

I came in this morning and noticed the NDT service was not running.  Here are the logs.  Going to restart it now.  I did add the --debug but the logs still don't look like they have much info.

 

 

If there is anything else you want me to send over just let me know.

 

Mike

 

Mike Pennington

Network Engineer

Connecticut Education Network (CEN)

860-622-4566

 

www.cen.ct.gov

 

 

-----Original Message-----
From: Pennington, Michael
Sent: Tuesday, December 02, 2014 2:28 PM
To: 'Andrew Lake';
Cc: Jeremy Palmer
Subject: RE: [perfsonar-user] Network Diagnostic Tester (NDT) service keeps dying on 3.4.1 toolkit host, web100srv not running

 

I've attached the 5 logs we have, and I do see the same type of entry in the logs on our end as well, attached for your viewing pleasure.

 

Mike Pennington

Network Engineer

Connecticut Education Network (CEN)

860-622-4566

 

www.cen.ct.gov

 

 

-----Original Message-----

From: Andrew Lake []

Sent: Tuesday, December 02, 2014 2:10 PM

To:

Cc: Pennington, Michael; Jeremy Palmer

Subject: Re: [perfsonar-user] Network Diagnostic Tester (NDT) service keeps dying on 3.4.1 toolkit host, web100srv not running

 

Hi,

 

Also is there anything in /var/log/ndt/fakewww_error.log? I noticed on one of our toolkit hosts it was down today and this was the last line in this log:

 

[Tue Dec 02 08:35:29 2014] [error] [client 180.76.6.134] Permission denied: path not allowed: /robots.txt

 

Curious if you have anything similar, possibly a web crawler is confusing fakewww?

 

Thanks,

Andy

 

 

On Dec 2, 2014, at 2:00 PM, Jason Zurawski <> wrote:

 

> And not super useful.  Lets try to make it more useful, edit /etc/sysconfig/ndt, and add "—debug" to the WEB100SRV_OPTIONS line.  After that, restart ndt.  Maybe in a couple of days, check to see if things behaved the same way, and there may be logs to back it up. 

>

> Thanks;

>

> -jason

>

> On Dec 2, 2014, at 1:47 PM, Pennington, Michael <> wrote:

>

>> Log attached, it's super small though.

>>

>> NDT version:

>>

>> rpm -qa | grep ndt

>> ndt-3.6.5.2-6.el6.x86_64

>> ndt-client-3.6.5.2-6.el6.x86_64

>> ndt-server-3.6.5.2-7.x86_64

>>

>>

>> Mike Pennington

>> Network Engineer

>> Connecticut Education Network (CEN)

>> 860-622-4566

>>

>> www.cen.ct.gov

>>

>>

>> -----Original Message-----

>> From: Jason Zurawski []

>> Sent: Tuesday, December 02, 2014 1:40 PM

>> To: Pennington, Michael; Jeremy Palmer

>> Cc:

>> Subject: Re: [perfsonar-user] Network Diagnostic Tester (NDT) service keeps dying on 3.4.1 toolkit host, web100srv not running

>>

>> Hey Guys;

>>

>> I guess the best thing to start off would be sending '/var/log/ndt/web100srv.log’, it may not have what we need though.  Also send the version of NDT you are using, e.g.

>>

>>> [zurawski@localhost ~]$ rpm -qa | grep ndt

>>> ndt-3.6.5.2-6.el6.x86_64

>>> ndt-client-3.6.5.2-6.el6.x86_64

>>> ndt-server-3.6.5.2-6.el6.x86_64

>>

>> Thanks;

>>

>> -jason

>>

>> On Dec 2, 2014, at 1:11 PM, Pennington, Michael <> wrote:

>>

>>> I've noticed the same thing on my end, I just restart it and it seems fine as well.  Sometimes for a day or two, sometimes for a week or two.  Haven't looked into it, but you aren't alone.

>>>

>>> Mike

>>>

>>> Mike Pennington

>>> Network Engineer

>>> Connecticut Education Network (CEN)

>>> 860-622-4566

>>>

>>> www.cen.ct.gov

>>>

>>>

>>> -----Original Message-----

>>> From: [] On Behalf Of Jeremy Palmer

>>> Sent: Tuesday, December 02, 2014 1:06 PM

>>> To:

>>> Subject: [perfsonar-user] Network Diagnostic Tester (NDT) service keeps dying on 3.4.1 toolkit host, web100srv not running

>>>

>>> Ever since upgrading my toolkit hosts to 3.4.1, the NDT service randomly stops running (shows as "Not Running" on the toolkit homepage). If you try to run a NDT test, it gives the error "Server process not running: Start web100srv process on remote server".

>>> When I restart the NDT service, I always get the following:

>>>

>>> # service ndt restart

>>> Stopping web100srv:                                        [FAILED]

>>> Stopping fakewww:                                          [  OK  ]

>>> Starting web100srv:                                        [  OK  ]

>>> Starting fakewww:                                          [  OK  ]

>>>

>>> Once I restart it, it seems to run fine for a few days but eventually dies again. This seems to be occurring randomly on all of my 3.4.1 toolkit hosts. I don't see anything of note in the /var/log/web100srv.log file.

>>>

>>> Anyone else having this issue or have any ideas on how to troubleshoot it?

>>>

>>> --

>>> Jeremy Palmer

>>> Senior Network Engineer

>>> ViaWest, Inc.

>>> Office: 720.891.1045

>>> Fax: 303-874-5236

>>> http://www.viawest.com

>> <web100srv.log>

 

Attachment: web100srv.log
Description: web100srv.log

Attachment: web100srv.log-20141116
Description: web100srv.log-20141116

Attachment: web100srv.log-20141123
Description: web100srv.log-20141123

Attachment: web100srv.log-20141130
Description: web100srv.log-20141130

Attachment: web100srv.log-20141207
Description: web100srv.log-20141207