perfSONAR User Q&A and Other Discussion

[Antoine Delvaux <>]

Hello Hervey,

These perfsonarbuoy scripts are now deprecated.

To remove all data from a perfSONAR archive, we provide you with the script 
/usr/lib/perfsonar/scripts/clean_esmond_db.sh 

If you want to migrate your data to another host or to keep it safe while 
re-installing the toolkit, there is 
/usr/lib/perfsonar/scripts/ps-toolkit-migrate-backup.sh and 
/usr/lib/perfsonar/scripts/ps-toolkit-migrate-restore.sh

Is this what you’re looking for?

Cheers,

--                                                                --
Antoine Delvaux                                     Systems Engineer
Poznań Supercomputing & Network Center                 Skype: toninb
GÉANT project                                    Tel: +221.703368313
http://www.geant.net                  XMPP: 

PGP fingerprint:  DC65 0D8B 6938 9229 33C3  18CA 4EB6 09D3 A333 3378

> Le 1 août 2016 à 11:35, Hervey Allen 
> <>
>  a écrit :
> 
> Hello Everyone:
> 
> I read through this old thread on removing host test data from a PS node.
> 
> I've got a new PS install here at the University of Guam running Toolkit
> version 3.5.1.4. I tried using the original ps-toolkit-migrate-backup.sh
> script /usr/lib/perfsonar/scripts/ but without luck. It looks like it
> might now have been updated for current version of perfSONAR? I tried
> updating the script at the first failure looking for
> /opt/perfsonar_ps/toolkit/etc/administrative_info to point it to the
> current location of administrative_info, but that did not work.
> 
> In any case, the new install has a number of initial test results we
> created when the box was first installed. We can live with completely
> removing all test results and starting over, but I was wondering if
> there is a proper method for removing historical results. Below there
> was mention of using:
> 
> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl -i root
> 
> To remove all the bwctl historical test results, but I don't see that
> script available on my newer install.
> 
> Andy advice or steering in the right direction would be appreciated.
> 
> Thanks!
> 
> Cheers,       
>       - Hervey
> 
> On 7/26/14 5:46 AM, Jeremy Palmer wrote:
>> This may or may not be what you are looking for, but a while back I had
>> some issues when I converted my nodes from standalone to a mesh config
>> and I needed to clear out the OWAMP database. I used the following
>> command to basically re-create the owamp database from scratch (deleting
>> ALL data in the process):
>> 
>> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/owdb.pl -i root
>> 
>> There is also a script in that directory for the bwctl database which I
>> assume does the same thing for that db:
>> 
>> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl -i root
>> 
>> This appears to completely drop and recreate the database, so make sure
>> thats what you really want to do.
>> 
>> Jeremy Palmer
>> Senior Network Engineer
>> ViaWest, Inc.
>> Office: 720.891.1045
>> Fax: 303-874-5236
>> http://www.viawest.com
>> 
>> On 7/25/2014 1:23 PM, Pol Llovet wrote:
>>> After a lot of trial and error, I have managed to improve the
>>> experience by clearing out older data, but I still have a ton of nodes
>>> in my Throughput graph list (most now listed in the Inactive Tests
>>> list).  I have experimented with removing nodes from the 201407_NODES
>>> table, but that messes other things up (even removing just one host
>>> will screw up the rest). I can only assume that there is some other
>>> master-list of nodes that I have to edit in order to remove the nodes
>>> permanently. 
>>> 
>>> Any help on that?  
>>> 
>>> Also, on a different but somewhat related topic: should I be using the
>>> perfsonar-users list for this? This is the list that is posted on the
>>> perfsonar site, but I saw the other list in the internet2 sympa list...
>>> 
>>> 
>>> Pol M. Llovet
>>> Research Computing / Middleware
>>> Montana State University
>>> w: 406-994-3416
>>> c: 406-646-6747
>>> 
>>> 
>>> On Fri, Jul 25, 2014 at 12:13 PM, Andrew Lake 
>>> <
>>> <mailto:>>
>>>  wrote:
>>> 
>>>    Hi,
>>> 
>>>    Ah sorry, i sent you the wrong FAQ. I meant
>>>    this: http://psps.perfsonar.net/toolkit/FAQs.html#Q29. I must have
>>>    scrolled around while looking for it and not cleared my address bar.
>>> 
>>>    It has pointer to a script already installed on your system. The
>>>    other one does not do what you want (it's good to correct the link
>>>    though). Sorry for the confusion.
>>> 
>>>    Thanks,
>>>    Andy
>>> 
>>>    On Jul 25, 2014, at 1:39 PM, Pol Llovet 
>>> <
>>>    
>>> <mailto:>>
>>>  wrote:
>>> 
>>>>    I take it back, that links to the html. I don't know how to link
>>>>    to the raw file on google code.
>>>> 
>>>> 
>>>>    Pol M. Llovet
>>>>    Research Computing / Middleware
>>>>    Montana State University
>>>>    w: 406-994-3416 <tel:406-994-3416>
>>>>    c: 406-646-6747 <tel:406-646-6747>
>>>> 
>>>> 
>>>>    On Fri, Jul 25, 2014 at 11:37 AM, Pol Llovet
>>>>    
>>>> <
>>>>  
>>>> <mailto:>>
>>>>  wrote:
>>>> 
>>>>        The link in the FAQ is wrong:
>>>> 
>>>>        # wget
>>>>        
>>>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>> 
>>>>        --2014-07-25 11:34:43--
>>>>         
>>>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>>        Resolving anonsvn.internet2.edu
>>>>        <http://anonsvn.internet2.edu>... 207.75.164.19
>>>>        <tel:207.75.164.19>, 2001:48a8:68fe::19
>>>>        Connecting to anonsvn.internet2.edu
>>>>        <http://anonsvn.internet2.edu/>|207.75.164.19
>>>>        <tel:207.75.164.19>|:80... connected.
>>>>        HTTP request sent, awaiting response... 500 Internal Server Error
>>>>        2014-07-25 11:34:43 ERROR 500: Internal Server Error.
>>>> 
>>>>        I think it should probably be this:
>>>> 
>>>>        
>>>> https://code.google.com/p/perfsonar-ps/source/browse/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>> 
>>>> 
>>>>        Pol M. Llovet
>>>>        Research Computing / Middleware
>>>>        Montana State University
>>>>        w: 406-994-3416 <tel:406-994-3416>
>>>>        c: 406-646-6747 <tel:406-646-6747>
>>>> 
>>>> 
>>>>        On Fri, Jul 25, 2014 at 6:47 AM, Andrew Lake 
>>>> <
>>>>        
>>>> <mailto:>>
>>>>  wrote:
>>>> 
>>>>            Hi,
>>>> 
>>>>            We have a script that can help with that. See
>>>>            http://psps.perfsonar.net/toolkit/FAQs.html#Q60 for
>>>>            examples. The examples will mysql dump the old data to
>>>>            files and then delete it from the database. If you don't
>>>>            care about saving dumps of the data you can drop the
>>>>            --mysqldump-opts and --dumpdir options, and replace them
>>>>            with --no-save-dumps See the --help of that script for a
>>>>            full listing of options.
>>>> 
>>>>            Thanks,
>>>>            Andy
>>>> 
>>>>            On Jul 24, 2014, at 5:46 PM, Pol Llovet
>>>>            
>>>> <
>>>>  
>>>> <mailto:>>
>>>>            wrote:
>>>> 
>>>>> I have tweaked the targeted hosts for bandwidth tests
>>>>            quite a lot, and now I am in a situation where I have
>>>>            lots of historical data for nodes that I don't need test
>>>>            against anymore.  The Graph UI takes a very long time to
>>>>            load due to the excessive number of hosts.
>>>>> 
>>>>> How do I remove the host data?  Is it just a matter of
>>>>            dumping the mysql database and clearing it?
>>>>> 
>>>>> thanks,
>>>>> 
>>>>> pol
>>>>> 
>>>>> Pol M. Llovet
>>>>> Research Computing / Middleware
>>>>> Montana State University
>>>>> w: 406-994-3416 <tel:406-994-3416>
>>>>> c: 406-646-6747 <tel:406-646-6747>
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
> 
> 
> -- 
> Hervey Allen      Assistant Director, Network Startup Resource Center
> 
>    http://nsrc.org/ : http://facebook.com/nsrc.org
> GPG Fingerprint:  AC08 31CB E453 6C65 2AB3 4EDB CEEB 5A74 C6E5 624F