perfSONAR User Q&A and Other Discussion

["Pennington, Michael" <>]

That seems to have done the trick.  It took a while for it to really calm down, but this morning everything is responding much better.  CPU is a little bit higher then I would like to see, especially compared to our other perfsonar box – but no real CPU spikes over 20% so not too worried.

 

Thanks again Dan!

 

Mike

 

Mike Pennington

Network Engineer

Connecticut Education Network (CEN)

860-622-4566

 

www.cen.ct.gov

 

CEN Conference May 15th 2015 in Hartford.  Register now- http://bit.ly/1MmRn9Z 

 

 

From: Pennington, Michael
Sent: Monday, April 27, 2015 3:04 PM
To: 'Daniel Doyle'
Cc:
Subject: RE: [perfsonar-user] Very high cpu on one of our perfsonar boxes

 

Perfect, I was hoping that was the answer.  I don’t actually have that many tests, I have more on the other box having no issues J  But since it’s not needed, I’ll just trash it on both systems.

 

Thanks!

 

Mike Pennington

Network Engineer

Connecticut Education Network (CEN)

860-622-4566

 

www.cen.ct.gov

 

CEN Conference May 15th 2015 in Hartford.  Register now- http://bit.ly/1MmRn9Z 

 

 

From: Daniel Doyle []
Sent: Monday, April 27, 2015 3:01 PM
To: Pennington, Michael
Cc:
Subject: Re: [perfsonar-user] Very high cpu on one of our perfsonar boxes

 

Mike,

 

Just judging on that picture's output it looks like you might have a whole lot of tests going to that one box. If you don't use the log analysis view on the toolkit, you can shut off the cron script that generates those files. If you tend to have lots of tests, even ad hoc ones, this process can be pretty long and expensive. It's located in /etc/cron.hourly/logscraper.cron and I believe you would have to remove the file to disable it. There is already an issue in the tracker to make this process more efficient / intelligent.

 

There may be other things going on, but you could start with that and see how far it gets you.

 

-Dan

 

On Apr 27, 2015, at 1:50 PM, Pennington, Michael <> wrote:

 

Hi all –

 

As I was checking our perfsonar boxes for something, I noticed one of them was acting very very sluggish.  I reloaded the box and the same issues occurred.  I then logged in and did a “top” command and it’s showing CPU at about 80% steady.  My other box, exactly the same just at a different location (it does have some different hosts it tests with), only shows about 6% CPU. 

 

Here is a screenshot from the problem box:

 

<image001.png>

 

Any ideas what to do to get CPU back down to normal?

 

Thanks

Mike

 

Mike Pennington

Network Engineer

Connecticut Education Network (CEN)

860-622-4566

 

www.cen.ct.gov

 

CEN Conference May 15th 2015 in Hartford.  Register now- http://bit.ly/1MmRn9Z

 

Dan Doyle

GlobalNOC Software Developer

1-812-856-3892