perfSONAR User Q&A and Other Discussion

[Hervey Allen <>]

On 8/1/16 11:33 PM, Andrew Lake wrote:
> Hi,
> 
> You can see the section in the docs here for a script that deletes old
> data: http://docs.perfsonar.net/multi_ma_backups.html#deleting-old-data.
> 

Ooh. I missed this. Thank you.

> Hope that helps,

Definitely. Much appreciated.

- Hervey

> Andy
> 
> 
> 
> On August 1, 2016 at 7:35:27 AM, Hervey Allen 
> (
> <mailto:>)
>  wrote:
> 
>> Hello Everyone:
>>
>> I read through this old thread on removing host test data from a PS node.
>>
>> I've got a new PS install here at the University of Guam running Toolkit
>> version 3.5.1.4. I tried using the original ps-toolkit-migrate-backup.sh
>> script /usr/lib/perfsonar/scripts/ but without luck. It looks like it
>> might now have been updated for current version of perfSONAR? I tried
>> updating the script at the first failure looking for
>> /opt/perfsonar_ps/toolkit/etc/administrative_info to point it to the
>> current location of administrative_info, but that did not work.
>>
>> In any case, the new install has a number of initial test results we
>> created when the box was first installed. We can live with completely
>> removing all test results and starting over, but I was wondering if
>> there is a proper method for removing historical results. Below there
>> was mention of using:
>>
>> /opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl <http://bwdb.pl> -i root
>>
>> To remove all the bwctl historical test results, but I don't see that
>> script available on my newer install.
>>
>> Andy advice or steering in the right direction would be appreciated.
>>
>> Thanks!
>>
>> Cheers,
>> - Hervey
>>
>> On 7/26/14 5:46 AM, Jeremy Palmer wrote:
>> > This may or may not be what you are looking for, but a while back I had
>> > some issues when I converted my nodes from standalone to a mesh config
>> > and I needed to clear out the OWAMP database. I used the following
>> > command to basically re-create the owamp database from scratch (deleting
>> > ALL data in the process):
>> >  
>> > /opt/perfsonar_ps/perfsonarbuoy_ma/bin/owdb.pl <http://owdb.pl> -i root
>> >  
>> > There is also a script in that directory for the bwctl database which I
>> > assume does the same thing for that db:
>> >  
>> > /opt/perfsonar_ps/perfsonarbuoy_ma/bin/bwdb.pl <http://bwdb.pl> -i root
>> >  
>> > This appears to completely drop and recreate the database, so make sure
>> > thats what you really want to do.
>> >  
>> > Jeremy Palmer
>> > Senior Network Engineer
>> > ViaWest, Inc.
>> > Office: 720.891.1045
>> > Fax: 303-874-5236
>> > http://www.viawest.com
>> >  
>> > On 7/25/2014 1:23 PM, Pol Llovet wrote:
>> >> After a lot of trial and error, I have managed to improve the
>> >> experience by clearing out older data, but I still have a ton of nodes
>> >> in my Throughput graph list (most now listed in the Inactive Tests
>> >> list).  I have experimented with removing nodes from the 201407_NODES
>> >> table, but that messes other things up (even removing just one host
>> >> will screw up the rest). I can only assume that there is some other
>> >> master-list of nodes that I have to edit in order to remove the nodes
>> >> permanently.  
>> >>
>> >> Any help on that?   
>> >>
>> >> Also, on a different but somewhat related topic: should I be using the
>> >> perfsonar-users list for this? This is the list that is posted on the
>> >> perfsonar site, but I saw the other list in the internet2 sympa list...
>> >>
>> >>
>> >> Pol M. Llovet
>> >> Research Computing / Middleware
>> >> Montana State University
>> >> w: 406-994-3416
>> >> c: 406-646-6747
>> >>
>> >>
>> >> On Fri, Jul 25, 2014 at 12:13 PM, Andrew Lake 
>> >> <
>> >>  
>> >> <mailto:>
>> >> <mailto:
>> >>  
>> >> <mailto:>>>
>> >>  wrote:
>> >>
>> >>     Hi,
>> >>
>> >>     Ah sorry, i sent you the wrong FAQ. I meant
>> >>     this: http://psps.perfsonar.net/toolkit/FAQs.html#Q29. I must have
>> >>     scrolled around while looking for it and not cleared my address bar.
>> >>
>> >>     It has pointer to a script already installed on your system. The
>> >>     other one does not do what you want (it's good to correct the link
>> >>     though). Sorry for the confusion.
>> >>
>> >>     Thanks,
>> >>     Andy
>> >>
>> >>     On Jul 25, 2014, at 1:39 PM, Pol Llovet 
>> >> <
>> >>  
>> >> <mailto:>
>> >>     
>> >> <mailto:
>> >>  
>> >> <mailto:>>>
>> >>  wrote:
>> >>
>> >>>     I take it back, that links to the html. I don't know how to link
>> >>>     to the raw file on google code.
>> >>>
>> >>>
>> >>>     Pol M. Llovet
>> >>>     Research Computing / Middleware
>> >>>     Montana State University
>> >>>     w: 406-994-3416 <tel:406-994-3416>
>> >>>     c: 406-646-6747 <tel:406-646-6747>
>> >>>
>> >>>
>> >>>     On Fri, Jul 25, 2014 at 11:37 AM, Pol Llovet
>> >>>     
>> >>> <
>> >>>  
>> >>> <mailto:>
>> <mailto:
>>  
>> <mailto:>>>
>>  wrote:
>> >>>
>> >>>         The link in the FAQ is wrong:
>> >>>
>> >>>         # wget
>> >>>         
>> >>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>
>> >>>
>> >>>         --2014-07-25 11:34:43--
>> >>>          
>> >>> http://anonsvn.internet2.edu/svn/perfSONAR-PS/trunk/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>
>> >>>         Resolving anonsvn.internet2.edu <http://anonsvn.internet2.edu>
>> >>>         <http://anonsvn.internet2.edu>... 207.75.164.19
>> >>>         <tel:207.75.164.19>, 2001:48a8:68fe::19
>> >>>         Connecting to anonsvn.internet2.edu 
>> >>> <http://anonsvn.internet2.edu>
>> >>>         <http://anonsvn.internet2.edu/>|207.75.164.19
>> >>>         <tel:207.75.164.19>|:80... connected.
>> >>>         HTTP request sent, awaiting response... 500 Internal Server 
>> >>> Error
>> >>>         2014-07-25 11:34:43 ERROR 500: Internal Server Error.
>> >>>
>> >>>         I think it should probably be this:
>> >>>
>> >>>         
>> >>> https://code.google.com/p/perfsonar-ps/source/browse/perfSONAR_PS-Toolkit/scripts/ps-toolkit-migrate-backup.sh
>>
>> >>>
>> >>>
>> >>>         Pol M. Llovet
>> >>>         Research Computing / Middleware
>> >>>         Montana State University
>> >>>         w: 406-994-3416 <tel:406-994-3416>
>> >>>         c: 406-646-6747 <tel:406-646-6747>
>> >>>
>> >>>
>> >>>         On Fri, Jul 25, 2014 at 6:47 AM, Andrew Lake 
>> >>> <
>> >>>  
>> >>> <mailto:>
>> >>>         
>> >>> <mailto:
>> >>>  
>> >>> <mailto:>>>
>> >>>  wrote:
>> >>>
>> >>>             Hi,
>> >>>
>> >>>             We have a script that can help with that. See
>> >>>             http://psps.perfsonar.net/toolkit/FAQs.html#Q60 for
>> >>>             examples. The examples will mysql dump the old data to
>> >>>             files and then delete it from the database. If you don't
>> >>>             care about saving dumps of the data you can drop the
>> >>>             --mysqldump-opts and --dumpdir options, and replace them
>> >>>             with --no-save-dumps See the --help of that script for a
>> >>>             full listing of options.
>> >>>
>> >>>             Thanks,
>> >>>             Andy
>> >>>
>> >>>             On Jul 24, 2014, at 5:46 PM, Pol Llovet
>> >>>             
>> >>> <
>> >>>  
>> >>> <mailto:>
>> <mailto:
>>  
>> <mailto:>>>
>> >>>             wrote:
>> >>>
>> >>>             > I have tweaked the targeted hosts for bandwidth tests
>> >>>             quite a lot, and now I am in a situation where I have
>> >>>             lots of historical data for nodes that I don't need test
>> >>>             against anymore.  The Graph UI takes a very long time to
>> >>>             load due to the excessive number of hosts.
>> >>>             >
>> >>>             > How do I remove the host data?  Is it just a matter of
>> >>>             dumping the mysql database and clearing it?
>> >>>             >
>> >>>             > thanks,
>> >>>             >
>> >>>             > pol
>> >>>             >
>> >>>             > Pol M. Llovet
>> >>>             > Research Computing / Middleware
>> >>>             > Montana State University
>> >>>             > w: 406-994-3416 <tel:406-994-3416>
>> >>>             > c: 406-646-6747 <tel:406-646-6747>
>> >>>
>> >>>
>> >>>
>> >>
>> >>
>> >  
>>
>>
>> -- 
>> Hervey Allen Assistant Director, Network Startup Resource Center
>> 
>>  
>> <mailto:>
>>  http://nsrc.org/ :
>> http://facebook.com/nsrc.org
>> GPG Fingerprint: AC08 31CB E453 6C65 2AB3 4EDB CEEB 5A74 C6E5 624F


-- 
Hervey Allen      Assistant Director, Network Startup Resource Center

   http://nsrc.org/ : http://facebook.com/nsrc.org
GPG Fingerprint:  AC08 31CB E453 6C65 2AB3 4EDB CEEB 5A74 C6E5 624F