perfSONAR User Q&A and Other Discussion

[Hervey Allen <>]

Hello Everyone:

I read through this old thread on removing host test data from a PS node.

I've got a new PS install here at the University of Guam running Toolkit
version 3.5.1.4. I tried using the original ps-toolkit-migrate-backup.sh
script /usr/lib/perfsonar/scripts/ but without luck. It looks like it
might now have been updated for current version of perfSONAR? I tried
updating the script at the first failure looking for
/opt/perfsonar_ps/toolkit/etc/administrative_info to point it to the
current location of administrative_info, but that did not work.

In any case, the new install has a number of initial test results we
created when the box was first installed. We can live with completely
removing all test results and starting over, but I was wondering if
there is a proper method for removing historical results. Below there
was mention of using:

/opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl -i root

To remove all the bwctl historical test results, but I don't see that
script available on my newer install.

Andy advice or steering in the right direction would be appreciated.

Thanks!

Cheers, 
        - Hervey

On 7/26/14 5:46 AM, Jeremy Palmer wrote:
> This may or may not be what you are looking for, but a while back I had
> some issues when I converted my nodes from standalone to a mesh config
> and I needed to clear out the OWAMP database. I used the following
> command to basically re-create the owamp database from scratch (deleting
> ALL data in the process):
> 
> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/owdb.pl -i root
> 
> There is also a script in that directory for the bwctl database which I
> assume does the same thing for that db:
> 
> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl -i root
> 
> This appears to completely drop and recreate the database, so make sure
> thats what you really want to do.
> 
> Jeremy Palmer
> Senior Network Engineer
> ViaWest, Inc.
> Office: 720.891.1045
> Fax: 303-874-5236
> http://www.viawest.com
> 
> On 7/25/2014 1:23 PM, Pol Llovet wrote:
>> After a lot of trial and error, I have managed to improve the
>> experience by clearing out older data, but I still have a ton of nodes
>> in my Throughput graph list (most now listed in the Inactive Tests
>> list).  I have experimented with removing nodes from the 201407_NODES
>> table, but that messes other things up (even removing just one host
>> will screw up the rest). I can only assume that there is some other
>> master-list of nodes that I have to edit in order to remove the nodes
>> permanently. 
>>
>> Any help on that?  
>>
>> Also, on a different but somewhat related topic: should I be using the
>> perfsonar-users list for this? This is the list that is posted on the
>> perfsonar site, but I saw the other list in the internet2 sympa list...
>>
>>
>> Pol M. Llovet
>> Research Computing / Middleware
>> Montana State University
>> w: 406-994-3416
>> c: 406-646-6747
>>
>>
>> On Fri, Jul 25, 2014 at 12:13 PM, Andrew Lake 
>> <
>> <mailto:>>
>>  wrote:
>>
>>     Hi,
>>
>>     Ah sorry, i sent you the wrong FAQ. I meant
>>     this: http://psps.perfsonar.net/toolkit/FAQs.html#Q29. I must have
>>     scrolled around while looking for it and not cleared my address bar.
>>
>>     It has pointer to a script already installed on your system. The
>>     other one does not do what you want (it's good to correct the link
>>     though). Sorry for the confusion.
>>
>>     Thanks,
>>     Andy
>>
>>     On Jul 25, 2014, at 1:39 PM, Pol Llovet 
>> <
>>     
>> <mailto:>>
>>  wrote:
>>
>>>     I take it back, that links to the html. I don't know how to link
>>>     to the raw file on google code.
>>>
>>>
>>>     Pol M. Llovet
>>>     Research Computing / Middleware
>>>     Montana State University
>>>     w: 406-994-3416 <tel:406-994-3416>
>>>     c: 406-646-6747 <tel:406-646-6747>
>>>
>>>
>>>     On Fri, Jul 25, 2014 at 11:37 AM, Pol Llovet
>>>     
>>> <
>>>  
>>> <mailto:>>
>>>  wrote:
>>>
>>>         The link in the FAQ is wrong:
>>>
>>>         # wget
>>>         
>>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>
>>>         --2014-07-25 11:34:43--
>>>          
>>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>         Resolving anonsvn.internet2.edu
>>>         <http://anonsvn.internet2.edu>... 207.75.164.19
>>>         <tel:207.75.164.19>, 2001:48a8:68fe::19
>>>         Connecting to anonsvn.internet2.edu
>>>         <http://anonsvn.internet2.edu/>|207.75.164.19
>>>         <tel:207.75.164.19>|:80... connected.
>>>         HTTP request sent, awaiting response... 500 Internal Server Error
>>>         2014-07-25 11:34:43 ERROR 500: Internal Server Error.
>>>
>>>         I think it should probably be this:
>>>
>>>         
>>> https://code.google.com/p/perfsonar-ps/source/browse/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>
>>>
>>>         Pol M. Llovet
>>>         Research Computing / Middleware
>>>         Montana State University
>>>         w: 406-994-3416 <tel:406-994-3416>
>>>         c: 406-646-6747 <tel:406-646-6747>
>>>
>>>
>>>         On Fri, Jul 25, 2014 at 6:47 AM, Andrew Lake 
>>> <
>>>         
>>> <mailto:>>
>>>  wrote:
>>>
>>>             Hi,
>>>
>>>             We have a script that can help with that. See
>>>             http://psps.perfsonar.net/toolkit/FAQs.html#Q60 for
>>>             examples. The examples will mysql dump the old data to
>>>             files and then delete it from the database. If you don't
>>>             care about saving dumps of the data you can drop the
>>>             --mysqldump-opts and --dumpdir options, and replace them
>>>             with --no-save-dumps See the --help of that script for a
>>>             full listing of options.
>>>
>>>             Thanks,
>>>             Andy
>>>
>>>             On Jul 24, 2014, at 5:46 PM, Pol Llovet
>>>             
>>> <
>>>  
>>> <mailto:>>
>>>             wrote:
>>>
>>>             > I have tweaked the targeted hosts for bandwidth tests
>>>             quite a lot, and now I am in a situation where I have
>>>             lots of historical data for nodes that I don't need test
>>>             against anymore.  The Graph UI takes a very long time to
>>>             load due to the excessive number of hosts.
>>>             >
>>>             > How do I remove the host data?  Is it just a matter of
>>>             dumping the mysql database and clearing it?
>>>             >
>>>             > thanks,
>>>             >
>>>             > pol
>>>             >
>>>             > Pol M. Llovet
>>>             > Research Computing / Middleware
>>>             > Montana State University
>>>             > w: 406-994-3416 <tel:406-994-3416>
>>>             > c: 406-646-6747 <tel:406-646-6747>
>>>
>>>
>>>
>>
>>
> 


-- 
Hervey Allen      Assistant Director, Network Startup Resource Center

   http://nsrc.org/ : http://facebook.com/nsrc.org
GPG Fingerprint:  AC08 31CB E453 6C65 2AB3 4EDB CEEB 5A74 C6E5 624F