perfSONAR User Q&A and Other Discussion

[Hervey Allen <>]

On 8/1/16 11:31 PM, Antoine Delvaux wrote:
> Hello Hervey,
> 
> These perfsonarbuoy scripts are now deprecated.
> 
> To remove all data from a perfSONAR archive, we provide you with the
> script /usr/lib/perfsonar/scripts/clean_esmond_db.sh
> 

Excellent. Thank you Antoine!

> If you want to migrate your data to another host or to keep it safe
> while re-installing the toolkit, there is
> /usr/lib/perfsonar/scripts/ps-toolkit-migrate-backup.sh and

I tried:

# /usr/lib/perfsonar/scripts/ps-toolkit-migrate-backup.sh /tmp/backup.tar

and

$ sudo /usr/lib/perfsonar/scripts/ps-toolkit-migrate-backup.sh
/tmp/backup.tar

and get:

Backing-up users...[SUCCESS]
Backing-up groups...[SUCCESS]
Backing-up passwords...[SUCCESS]
Backing up administrative users...[SUCCESS]
Backing-up administrative info...grep:
/opt/perfsonar_ps/toolkit/etc/administrative_info: No such file or directory
Unable to copy /opt/perfsonar_ps/toolkit/etc/administrative_info


Perhaps I am calling this incorrectly?

> /usr/lib/perfsonar/scripts/ps-toolkit-migrate-restore.sh
> 
> Is this what you’re looking for?
> 

But, yes, this should work as I think we are going to start over on the
tests on this.

Thank you Antoine.


Cheers,
        - Hervey

> Cheers,
> 
> --                                                                -- 
> Antoine Delvaux                                     Systems Engineer 
> Poznań Supercomputing & Network Center                 Skype: toninb 
> GÉANT project                                    Tel: +221.703368313 
> http://www.geant.net                  XMPP: 
> 
>  
> PGP fingerprint:  DC65 0D8B 6938 9229 33C3  18CA 4EB6 09D3 A333 3378
> 
>> Le 1 août 2016 à 11:35, Hervey Allen 
>> <>
>>  a écrit :
>> 
>> Hello Everyone:
>> 
>> I read through this old thread on removing host test data from a PS
>> node.
>> 
>> I've got a new PS install here at the University of Guam running
>> Toolkit version 3.5.1.4. I tried using the original
>> ps-toolkit-migrate-backup.sh script /usr/lib/perfsonar/scripts/ but
>> without luck. It looks like it might now have been updated for
>> current version of perfSONAR? I tried updating the script at the
>> first failure looking for 
>> /opt/perfsonar_ps/toolkit/etc/administrative_info to point it to
>> the current location of administrative_info, but that did not
>> work.
>> 
>> In any case, the new install has a number of initial test results
>> we created when the box was first installed. We can live with
>> completely removing all test results and starting over, but I was
>> wondering if there is a proper method for removing historical
>> results. Below there was mention of using:
>> 
>> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl -i root
>> 
>> To remove all the bwctl historical test results, but I don't see
>> that script available on my newer install.
>> 
>> Andy advice or steering in the right direction would be
>> appreciated.
>> 
>> Thanks!
>> 
>> Cheers, - Hervey
>> 
>> On 7/26/14 5:46 AM, Jeremy Palmer wrote:
>>> This may or may not be what you are looking for, but a while back
>>> I had some issues when I converted my nodes from standalone to a
>>> mesh config and I needed to clear out the OWAMP database. I used
>>> the following command to basically re-create the owamp database
>>> from scratch (deleting ALL data in the process):
>>> 
>>> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/owdb.pl -i root
>>> 
>>> There is also a script in that directory for the bwctl database
>>> which I assume does the same thing for that db:
>>> 
>>> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl -i root
>>> 
>>> This appears to completely drop and recreate the database, so
>>> make sure thats what you really want to do.
>>> 
>>> Jeremy Palmer Senior Network Engineer ViaWest, Inc. Office:
>>> 720.891.1045 Fax: 303-874-5236 http://www.viawest.com
>>> 
>>> On 7/25/2014 1:23 PM, Pol Llovet wrote:
>>>> After a lot of trial and error, I have managed to improve the 
>>>> experience by clearing out older data, but I still have a ton
>>>> of nodes in my Throughput graph list (most now listed in the
>>>> Inactive Tests list).  I have experimented with removing nodes
>>>> from the 201407_NODES table, but that messes other things up
>>>> (even removing just one host will screw up the rest). I can
>>>> only assume that there is some other master-list of nodes that
>>>> I have to edit in order to remove the nodes permanently.
>>>> 
>>>> Any help on that?
>>>> 
>>>> Also, on a different but somewhat related topic: should I be
>>>> using the perfsonar-users list for this? This is the list that
>>>> is posted on the perfsonar site, but I saw the other list in
>>>> the internet2 sympa list...
>>>> 
>>>> 
>>>> Pol M. Llovet Research Computing / Middleware Montana State
>>>> University w: 406-994-3416 c: 406-646-6747
>>>> 
>>>> 
>>>> On Fri, Jul 25, 2014 at 12:13 PM, Andrew Lake 
>>>> <
>>>>  
>>>> <mailto:>>
>>>>  wrote:
>>>> 
>>>> Hi,
>>>> 
>>>> Ah sorry, i sent you the wrong FAQ. I meant this:
>>>> http://psps.perfsonar.net/toolkit/FAQs.html#Q29. I must have 
>>>> scrolled around while looking for it and not cleared my address
>>>> bar.
>>>> 
>>>> It has pointer to a script already installed on your system.
>>>> The other one does not do what you want (it's good to correct
>>>> the link though). Sorry for the confusion.
>>>> 
>>>> Thanks, Andy
>>>> 
>>>> On Jul 25, 2014, at 1:39 PM, Pol Llovet
>>>> <
>>>>  
>>>> <mailto:>>
>>>> wrote:
>>>> 
>>>>> I take it back, that links to the html. I don't know how to
>>>>> link to the raw file on google code.
>>>>> 
>>>>> 
>>>>> Pol M. Llovet Research Computing / Middleware Montana State
>>>>> University w: 406-994-3416 <tel:406-994-3416> c: 406-646-6747
>>>>> <tel:406-646-6747>
>>>>> 
>>>>> 
>>>>> On Fri, Jul 25, 2014 at 11:37 AM, Pol Llovet 
>>>>> <
>>>>>  
>>>>> <mailto:>>
>>>>> wrote:
>>>>> 
>>>>> The link in the FAQ is wrong:
>>>>> 
>>>>> # wget 
>>>>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>>>
>>>>>
>>>>> 
--2014-07-25 11:34:43--
>>>>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>>>
>>>>> 
Resolving anonsvn.internet2.edu
>>>>> <http://anonsvn.internet2.edu>... 207.75.164.19 
>>>>> <tel:207.75.164.19>, 2001:48a8:68fe::19 Connecting to
>>>>> anonsvn.internet2.edu 
>>>>> <http://anonsvn.internet2.edu/>|207.75.164.19 
>>>>> <tel:207.75.164.19>|:80... connected. HTTP request sent,
>>>>> awaiting response... 500 Internal Server Error 2014-07-25
>>>>> 11:34:43 ERROR 500: Internal Server Error.
>>>>> 
>>>>> I think it should probably be this:
>>>>> 
>>>>> https://code.google.com/p/perfsonar-ps/source/browse/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>>>>
>>>>>
>>>>>
>>>>> 
Pol M. Llovet
>>>>> Research Computing / Middleware Montana State University w:
>>>>> 406-994-3416 <tel:406-994-3416> c: 406-646-6747
>>>>> <tel:406-646-6747>
>>>>> 
>>>>> 
>>>>> On Fri, Jul 25, 2014 at 6:47 AM, Andrew Lake 
>>>>> <
>>>>>  
>>>>> <mailto:>>
>>>>>  wrote:
>>>>> 
>>>>> Hi,
>>>>> 
>>>>> We have a script that can help with that. See 
>>>>> http://psps.perfsonar.net/toolkit/FAQs.html#Q60 for examples.
>>>>> The examples will mysql dump the old data to files and then
>>>>> delete it from the database. If you don't care about saving
>>>>> dumps of the data you can drop the --mysqldump-opts and
>>>>> --dumpdir options, and replace them with --no-save-dumps See
>>>>> the --help of that script for a full listing of options.
>>>>> 
>>>>> Thanks, Andy
>>>>> 
>>>>> On Jul 24, 2014, at 5:46 PM, Pol Llovet 
>>>>> <
>>>>>  
>>>>> <mailto:>>
>>>>>  
>>>>> wrote:
>>>>> 
>>>>>> I have tweaked the targeted hosts for bandwidth tests
>>>>> quite a lot, and now I am in a situation where I have lots of
>>>>> historical data for nodes that I don't need test against
>>>>> anymore.  The Graph UI takes a very long time to load due to
>>>>> the excessive number of hosts.
>>>>>> 
>>>>>> How do I remove the host data?  Is it just a matter of
>>>>> dumping the mysql database and clearing it?
>>>>>> 
>>>>>> thanks,
>>>>>> 
>>>>>> pol
>>>>>> 
>>>>>> Pol M. Llovet Research Computing / Middleware Montana State
>>>>>> University w: 406-994-3416 <tel:406-994-3416> c:
>>>>>> 406-646-6747 <tel:406-646-6747>
>>>>> 
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>> 
>> 
>> -- Hervey Allen      Assistant Director, Network Startup Resource
>> Center 
>> 
>>    http://nsrc.org/ :
>> http://facebook.com/nsrc.org GPG Fingerprint:  AC08 31CB E453 6C65
>> 2AB3 4EDB CEEB 5A74 C6E5 624F
> 


-- 
Hervey Allen      Assistant Director, Network Startup Resource Center

   http://nsrc.org/ : http://facebook.com/nsrc.org
GPG Fingerprint:  AC08 31CB E453 6C65 2AB3 4EDB CEEB 5A74 C6E5 624F