perfSONAR User Q&A and Other Discussion

[Piotr Pikusa <>]

Dear Ralph,

Sorry for misunderstood, I I assumed, you gave a snmp as example of all 
metrics. For that day, perfSONAR doesn't support SMNP MP. So, yes 
putting the data into MySQL database yourself would be a proper way. 
After reading docs from doc directory, I suppose you will know what data 
put into what tables ;) If not, please let us
know. It would be great if you write your experience from this process 
here. It would help us  in developing process to make perfSONAR better 
application!

Cheers!
Piotr Pikusa
PSNC
www.man.poznan.pl



Ralph Niederberger wrote:
> Dear Piotr,
>
> first of all many thanks for your response.
> But that is what I am critizising with perfSONAR. Noone tells you 
> where to find the documents and descriptions.
> At least not at the "official GEANT2 MDM perfsonar documentation page".
>
> Concerning 1.): From the perfsonar-admin guide SQL-MA stores data 
> concerning IP interface link utilization, capacity input errors and 
> output drops
> as well as circuit/lightpath status.  This info you normally can get 
> by local system commands or snmp. As far as I see there are no
> services which provide those kind of services. At least BWCTL and 
> OWAMP don't do this. You could potentially do it with the
> "Telnet/SSH MP" service or "Command Line MP" service. So storing the 
> data myself? Let's say e.g. I would like to get interface statistics
> of a router with 10 interfaces. Here I have to use snmp for 
> information retrieval, I assume.  So putting the data into the mySQL 
> database
> myself would be the way to go?
>
> concerning 2.): Thanks for the info. I will have a look into it.
>
> concerning 3.):  Thanks again for the info. I will have a look into 
> this document also.
>
> Would have been fine, if all those info would be available via the 
> official web page. http://www.perfsonar.net (if this is the official 
> one)  (;-)
>
> best regards
>
> Ralph
>
> Piotr Pikusa schrieb:
> > Hi Ralph!
> >
> > 1. As you could probably read in perfSONAR docs, SQL-MA is one of 
> > services in perfSONAR project. Main idea of perfSONAR is to create 
> > services with individual functionality  and make  them working  
> > through interaction.  There is  LookupService  dedicated  to store 
> > and  send  information about  all the services available in  the 
> > network  environment.
> > Since SQL-MA is storing service you it obviously must have some data 
> > to store ;) These data are sent to SQL-MA by measurements services 
> > i.e. BWCTL  and OWAMP MP  (all  MP  services  you will find here: 
> > https://wiki.man.poznan.pl/perfsonar-mdm/index.php/PerfSONAR_Downloads 
> > ). So to store measurement data you must have at least three 
> > services: LS, MP and MA (i.e. SQL-MA). MP will measure data. LS will 
> > tell MP where to send data to store them, and MA will store data sent 
> > by MP. You don't need to send any snmp request yourself. SQL-MA store 
> > measurement data itself, but only if some service sent them to it. Of 
> > course you can have actually your database full of data and then 
> > SQL-MA can send archivered data to some visualization tool i.e 
> > perfSONAR UI.
> >
> >
> > 2. Metadata file was thought i.a to  differ many interfaces which 
> > give the same data type. So one table - one measurement type, many 
> > interfaces. How to differ interfaces, you can read about it in docs 
> > files, especially in Interface_Specification.doc . (look in the 
> > doc/geant-2-java-sql-ma directory)
> >
> > 3. If you want to change/add new tables, you probably want to add new 
> > metrics to SQL-MA. Information about how to do it you can find  here: 
> > https://wiki.man.poznan.pl/perfsonar-mdm/index.php/Adding_new_metrics_to_the_SQL_MA 
> >
> > Since SQL-MA is webservice and eXist is webapp they are depend on 
> > tomcat. Good practice is to restart tomcat after any hand-made change 
> > in config files.
> >
> > I hope you found some useful information in my e-mail, If you have 
> > more questions or I missed the point, please write to perfsonar-user 
> > group. Hope you will find our services useful and admin-friendly :)
> >
> > Cheers
> > Piotr Pikusa
> > PSNC
> >
> >
> >
> > Ralph Niederberger wrote:
> > > Dear all,
> > >
> > > sorry for the, may be stupied, questions.
> > >
> > > 1.) Could someone tell me, if I have to generate data myself for 
> > > e.g. the SQL MA service.
> > >     The perfSONAR MDM 3.1 admin guide states at page 43:
> > >     "The SQL MA stores link data that is collected by measurement 
> > > tools. ..."
> > >     So, who stores?  Do I have to make an snmp request myself and 
> > > put the data via
> > >     mysql statements into the tables provided, i.e. configured in 
> > > SQL MA or does the
> > >     SQL MA tool retrieve and store the measurement data itself?
> > >
> > > 2.) If I would like to control several interfaces, do I have to 
> > > create different discard,
> > >     error and utilization mysql tables for every interface or can I 
> > > differ between the
> > >     interfaces by storing the info with different "metadataId"s?
> > >
> > > 3.) What are the dependencies between Tomcat server, exist database 
> > > configurations
> > >     and e.g. SQL databases? E.g. what are the dependencies when SQL 
> > > MA stiching
> > >     is done. Especially if you change some configurations 
> > > afterwards, e.g. change/add     sql tables, which services have to 
> > > restarted and in which chronological orders do
> > >     they have to be restarted.
> > >
> > > Thanks in advance
> > >
> > > Ralph