perfSONAR User Q&A and Other Discussion

[Jason Zurawski <>]

All;

Great, keep us posted if the event happens again, and send along the various 
logs if it does.  

Thanks;

-jason

> On Dec 2, 2014, at 2:52 PM, Jeremy Palmer 
> <>
>  wrote:
> 
> My fakewww logs look similar. I do have some of the "Permission Denied" 
> messages, tho I assumed these were normal "this file doesn't exist" errors.
> 
> [Sun Nov 30 03:51:33 2014] [notice] fakewww server started (NDT version 
> 3.6.5.2)
> [Sun Nov 30 03:51:33 2014] [notice]     port = 7123
> [Sun Nov 30 03:51:33 2014] [notice]     federated mode = off
> [Sun Nov 30 03:51:33 2014] [notice]     access log = 
> /var/log/ndt/fakewww_access.log
> [Sun Nov 30 03:51:33 2014] [notice]     error log = 
> /var/log/ndt/fakewww_error.log
> [Sun Nov 30 03:51:33 2014] [notice]     basedir = /usr/ndt
> [Sun Nov 30 03:51:33 2014] [notice]     syslog facility = default (128)
> [Sun Nov 30 03:51:33 2014] [notice]     debug level set to 0
> [Mon Dec 01 19:55:25 2014] [error] [client 
> baiduspider-123-125-71-117.crawl.baidu.com] Permission denied: path not 
> allowed: /robots.txt
> [Tue Dec 02 00:03:25 2014] [error] [client 
> baiduspider-180-76-5-74.crawl.baidu.com] Permission denied: path not 
> allowed: /robots.txt
> [Tue Dec 02 06:15:32 2014] [error] [client 
> crawl-66-249-64-47.googlebot.com] Permission denied: path not allowed: 
> /robots.txt
> [Tue Dec 02 08:52:02 2014] [error] [client 
> ops.afwd01.corp.slc09.viawest.net] Permission denied: path not allowed: 
> /favicon.ico
> [Tue Dec 02 08:52:02 2014] [error] [client 
> ops.afwd01.corp.slc09.viawest.net] Permission denied: path not allowed: 
> /favicon.ico
> [Tue Dec 02 08:52:07 2014] [error] [client 
> ops.afwd01.corp.slc09.viawest.net] Permission denied: path not allowed: 
> /Tcpbw100_msgs.class
> [Tue Dec 02 08:52:07 2014] [error] [client 
> ops.afwd01.corp.slc09.viawest.net] Permission denied: path not allowed: 
> /Tcpbw100_msgs.properties
> 
> Here is the NDT version I'm running on one of my toolkit boxes. This one is 
> a 32-bit box but I'm also having the same issue on a 64-bit box.
> 
> rpm -qa | grep ndt
> ndt-client-3.6.5.2-6.el6.i386
> ndt-server-3.6.5.2-7.i386
> ndt-3.6.5.2-6.el6.i386
> 
> I've enabled debug as suggested.
> 
> Jeremy Palmer
> Senior Network Engineer
> ViaWest, Inc.
> Office: 720.891.1045
> Fax: 303-874-5236
> http://www.viawest.com
> 
> On 12/2/2014 12:09 PM, Andrew Lake wrote:
>> Hi,
>> 
>> Also is there anything in /var/log/ndt/fakewww_error.log? I noticed on one 
>> of our toolkit hosts it was down today and this was the last line in this 
>> log:
>> 
>> [Tue Dec 02 08:35:29 2014] [error] [client 180.76.6.134] Permission 
>> denied: path not allowed: /robots.txt
>> 
>> Curious if you have anything similar, possibly a web crawler is confusing 
>> fakewww?
>> 
>> Thanks,
>> Andy
>> 
>> 
>> On Dec 2, 2014, at 2:00 PM, Jason Zurawski 
>> <>
>>  wrote:
>> 
>>> And not super useful.  Lets try to make it more useful, edit 
>>> /etc/sysconfig/ndt, and add "—debug" to the WEB100SRV_OPTIONS line.  
>>> After that, restart ndt.  Maybe in a couple of days, check to see if 
>>> things behaved the same way, and there may be logs to back it up.
>>> 
>>> Thanks;
>>> 
>>> -jason
>>> 
>>> On Dec 2, 2014, at 1:47 PM, Pennington, Michael 
>>> <>
>>>  wrote:
>>> 
>>>> Log attached, it's super small though.
>>>> 
>>>> NDT version:
>>>> 
>>>> rpm -qa | grep ndt
>>>> ndt-3.6.5.2-6.el6.x86_64
>>>> ndt-client-3.6.5.2-6.el6.x86_64
>>>> ndt-server-3.6.5.2-7.x86_64
>>>> 
>>>> 
>>>> Mike Pennington
>>>> Network Engineer
>>>> Connecticut Education Network (CEN)
>>>> 860-622-4566
>>>> 
>>>> www.cen.ct.gov
>>>> 
>>>> 
>>>> -----Original Message-----
>>>> From: Jason Zurawski 
>>>> [mailto:]
>>>> Sent: Tuesday, December 02, 2014 1:40 PM
>>>> To: Pennington, Michael; Jeremy Palmer
>>>> Cc: 
>>>> 
>>>> Subject: Re: [perfsonar-user] Network Diagnostic Tester (NDT) service 
>>>> keeps dying on 3.4.1 toolkit host, web100srv not running
>>>> 
>>>> Hey Guys;
>>>> 
>>>> I guess the best thing to start off would be sending 
>>>> '/var/log/ndt/web100srv.log’, it may not have what we need though.  Also 
>>>> send the version of NDT you are using, e.g.
>>>> 
>>>>> [zurawski@localhost
>>>>>  ~]$ rpm -qa | grep ndt
>>>>> ndt-3.6.5.2-6.el6.x86_64
>>>>> ndt-client-3.6.5.2-6.el6.x86_64
>>>>> ndt-server-3.6.5.2-6.el6.x86_64
>>>> Thanks;
>>>> 
>>>> -jason
>>>> 
>>>> On Dec 2, 2014, at 1:11 PM, Pennington, Michael 
>>>> <>
>>>>  wrote:
>>>> 
>>>>> I've noticed the same thing on my end, I just restart it and it seems 
>>>>> fine as well.  Sometimes for a day or two, sometimes for a week or two. 
>>>>>  Haven't looked into it, but you aren't alone.
>>>>> 
>>>>> Mike
>>>>> 
>>>>> Mike Pennington
>>>>> Network Engineer
>>>>> Connecticut Education Network (CEN)
>>>>> 860-622-4566
>>>>> 
>>>>> www.cen.ct.gov
>>>>> 
>>>>> 
>>>>> -----Original Message-----
>>>>> From: 
>>>>> 
>>>>>  
>>>>> [mailto:]
>>>>>  On Behalf Of Jeremy Palmer
>>>>> Sent: Tuesday, December 02, 2014 1:06 PM
>>>>> To: 
>>>>> 
>>>>> Subject: [perfsonar-user] Network Diagnostic Tester (NDT) service keeps 
>>>>> dying on 3.4.1 toolkit host, web100srv not running
>>>>> 
>>>>> Ever since upgrading my toolkit hosts to 3.4.1, the NDT service 
>>>>> randomly stops running (shows as "Not Running" on the toolkit 
>>>>> homepage). If you try to run a NDT test, it gives the error "Server 
>>>>> process not running: Start web100srv process on remote server".
>>>>> When I restart the NDT service, I always get the following:
>>>>> 
>>>>> # service ndt restart
>>>>> Stopping web100srv:                                        [FAILED]
>>>>> Stopping fakewww:                                          [  OK  ]
>>>>> Starting web100srv:                                        [  OK  ]
>>>>> Starting fakewww:                                          [  OK  ]
>>>>> 
>>>>> Once I restart it, it seems to run fine for a few days but eventually 
>>>>> dies again. This seems to be occurring randomly on all of my 3.4.1 
>>>>> toolkit hosts. I don't see anything of note in the 
>>>>> /var/log/web100srv.log file.
>>>>> 
>>>>> Anyone else having this issue or have any ideas on how to troubleshoot 
>>>>> it?
>>>>> 
>>>>> --
>>>>> Jeremy Palmer
>>>>> Senior Network Engineer
>>>>> ViaWest, Inc.
>>>>> Office: 720.891.1045
>>>>> Fax: 303-874-5236
>>>>> http://www.viawest.com
>>>> <web100srv.log>