perfSONAR User Q&A and Other Discussion

[maxim <>]

thanks for tip, Joe. 
Yes, something wrong about my eXist config and I am trying to figure it out.
Unfortunately current release of perfSONAR is not very user friendly and
the whole installation process is far from optimal ( essentially its kind of
bad design to have multiple
configuration files to poke around for single product).
--Maxim 

> -----Original Message-----
> From: Joe Metzger 
> [mailto:]
>  
> Sent: Friday, September 15, 2006 9:08 AM
> To: maxim
> Cc: 'Vedrin Jeliazkov'; 
> 
> Subject: Re: [perfsonar-user] emty data
> 
> Maxim,
> Here is what I have done when running up against similar problems.
> 
> Check the properties file to see what config file it is referencing.
> 
> For example I have:
> 
> mea1> cd /usr/local/esnet/perfsonar/perfSONAR-1.0/conf
> mea1> grep ESnet service.properties.ma
> service.ma.conf_file=/usr/local/esnet/perfsonar/perfSONAR-1.0/
> conf/rrd-database_ESnet.xml
> mea1> grep xmldb *
> service.properties.ma:component.ma.xmldb.db_uri=xmldb:exist://
> localhost:8680/exist/xmlrpc/db/rrdmaconfig
> service.properties.ma:component.ma.xmldb.db_username=rrdmaservice
> service.properties.ma:component.ma.xmldb.db_status=on
> service.properties.ma:service.ma.xmldb.db_store=off
> service.properties.ma:service.ma.rrd.xmldb.db_store.data_dir=/
> usr/local/esnet/perfsonar/perfSONAR-1.0
> mea1>
> 
> Then go into eXist and verify that a file with the name 
> specified by the ma.conf_file exists in the directory 
> specified by the db.username.
> 
> 
>   setenv CLASSPATH /usr/local/jdk1.5.0/lib
>   setenv JAVA_HOME /usr/local/jdk1.5.0/
>   setenv EXIST_HOME /usr/local/eXist/
>   /usr/local/eXist/bin/./client.sh -s
> -ouri=xmldb:exist://localhost:8680/exist/xmlrpc -u 
> rrdmaservice -P password
> 
> 
> exist:/db>ls
> drwur-ur-u admin     dba       rrdmaconfig
> drwurwu--- admin     dba       system
> exist:/db>cd rrdmaconfig
> exist:/db/rrdmaconfig>ls
> -rwur-ur-u      rrdmaservice    guest   rrd-database_TEST.xml 
>   Tue Aug 
> 29 14:11:50 PDT 2006
> -rwur-ur-u      rrdmaservice    guest   
> rrd-database_ESnet.xml  Tue Aug 
> 29 14:12:12 PDT 2006
> exist:/db/rrdmaconfig>
> 
> 
> If this fails, study the log files to see if it is actually reading
> the config and generating an error message about parsing it.
> 
> If that is the case you have to look through your config file to find
> where it doesn't match the 1.0 schema.
> 
> --Joe
> 
> 
> maxim wrote:
> > hmm, that’s strange. How can I debug it and find where the culprit ?
> > the MA config file is below.
> > Thanks,
> >          Maxim.
> >  <?xml version="1.0" encoding="UTF-8"?>
> > 
> > 
> > <!-- 
> ===================================================================
> > <description>
> >    MA RRD configuration file
> > 
> >    $Id: fermilab_ma.xml,v 1.10 2005/10/25 05:39:08 zurawski Exp $
> >    project: perfSONAR
> > 
> > Notes:
> >    This is the configuration file which contains the information 
> >    about RRD files from  Fermilab
> > 
> > </description>
> > 
> ==============================================================
> ====== -->
> > 
> > <nmwg:store xmlns="http://ggf.org/ns/nmwg/base/2.0/"; 
> >                  xmlns:nmwg="http://ggf.org/ns/nmwg/base/2.0/"; 
> >  
> > 
> xmlns:netutil="http://ggf.org/ns/nmwg/characteristic/utilizati
> on/2.0/" 
> >                  
> xmlns:nmwgt="http://ggf.org/ns/nmwg/topology/2.0/";> 
> >                  
> >                  <!--  metadata section  -->
> > 
> >        <nmwg:metadata id="meta1">
> >          <netutil:subject id="subj1">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet2_2</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Link to lhcopnmon1 
> monitoring
> > host</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data1" metadataIdRef="meta1">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-
> interfaces/ten
> > gigabitethernet2_2.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> >   <nmwg:metadata id="meta2">
> >          <netutil:subject id="subj2">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet2_2</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Link to lhcopnmon1 
> monitoring
> > host</nmwgt:ifDescription>
> >                    <nmwgt:direction>out</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data2" metadataIdRef="meta2">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-
> interfaces/ten
> > gigabitethernet2_2.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds1</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> > 
> >        <nmwg:metadata id="meta3">
> >          <netutil:subject id="subj3">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet3_4</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink 10G to
> > core</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data3" metadataIdRef="meta3">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-
> interfaces/ten
> > gigabitethernet3_4.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > ifAddress type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet3_4</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink 10G to
> > core</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data3" metadataIdRef="meta3">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-
> interfaces/ten
> > gigabitethernet3_4.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> > 
> >        <nmwg:metadata id="meta4">
> >          <netutil:subject id="subj4">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet3_4</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink 10G to
> > core</nmwgt:ifDescription>
> >                    <nmwgt:direction>out</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data4" metadataIdRef="meta4">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-
> interfaces/ten
> > gigabitethernet3_4.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds1</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> > 
> >        <nmwg:metadata id="meta5">
> >          <netutil:subject id="subj5">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet1_1</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink to
> > Starlight</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data5" metadataIdRef="meta5">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-
> interfaces/ten
> > gigabitethernet1_1.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> >         <nmwg:metadata id="meta6">
> >          <netutil:subject id="subj6">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet1_1</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink to
> > Starlight</nmwgt:ifDescription>
> >                    <nmwgt:direction>out</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data6" metadataIdRef="meta6">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-
> interfaces/ten
> > gigabitethernet1_1.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds1</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> >         </nmwg:store>
> >> -----Original Message-----
> >> From: Vedrin Jeliazkov 
> >> [mailto:]
> >>  
> >> Sent: Friday, September 15, 2006 2:23 AM
> >> To: maxim
> >> Cc: 
> >> 
> >> Subject: Re: [perfsonar-user] emty data
> >>
> >> Hi Maxim,
> >>
> >> After launching perfsonarUI in debug mode we found that your 
> >> service returns an empty reply to the MetadataKeyRequest, 
> >> which is used to fetch the list of
> >> interfaces:
> >>
> >> 2006-09-15 10:12:54,437 [Thread-2] DEBUG 
> >> org.perfsonar.client.ma.MARequest2 - Sending request
> >> to 
> >> FERMILAB,http://lhcopnmon1-mgm.fnal.gov:8080/axis/services/Mea
> >> surementArchiveService,NMWG2v2_netutil
> >> 2006-09-15 10:12:54,468 [Thread-2] DEBUG 
> >> org.perfsonar.client.ma.MARequest2 - <nmwg:message id="1" 
> >> type="MetadataKeyRequest"
> >> 
> xmlns:netutil="http://ggf.org/ns/nmwg/characteristic/utilization/2.0/";
> >> xmlns:nmwg="http://ggf.org/ns/nmwg/base/2.0/";
> >> xmlns:nmwgt="http://ggf.org/ns/nmwg/topology/2.0/";
> >> 
> xmlns:select="http://ggf.org/ns/nmwg/ops/select/2.0/";><nmwg:metadata
> >> id="meta1"><netutil:subject
> >> id="iusub1"><nmwgt:interface/></netutil:subject><nmwg:eventTyp
> >> e>utilization</nmwg:eventType></nmwg:metadata><nmwg:data
> >> id="data1" metadataIdRef="meta1"/></nmwg:message>
> >> 2006-09-15 10:12:56,390 [Thread-2] DEBUG 
> >> org.perfsonar.client.ma.MARequest2 - Sent query using AXIS...
> >>
> >> 2006-09-15 10:12:56,390 [Thread-2] DEBUG 
> >> org.perfsonar.client.ma.MARequest2 - Received answer (?)...
> >>
> >> 2006-09-15 10:12:56,406 [Thread-2] DEBUG 
> >> org.perfsonar.client.ma.MARequest2 - <?xml version="1.0" 
> >> encoding="UTF-8"?> <nmwg:message 
> >> xmlns:nmwg="http://ggf.org/ns/nmwg/base/2.0/";
> >> id="localhost.localdomain.-326c70b0:10dae9055bd:70ef" />
> >>
> >> 2006-09-15 10:12:56,421 [Thread-2] INFO  
> >> org.perfsonar.client.ma.MARequest2 - Client exiting
> >>
> >> It looks like the service doesn't know about any interfaces...
> >>
> >> Best regards,
> >> Vedrin
> >>
> >> PS: Debug mode in perfsonarUI can be enabled by executing the 
> >> following
> >> command:
> >>
> >> java -Dperfsonar.debugging=true -jar perfSonarApp.jar
> >>
> >> maxim 
> >> <>
> >>  wrote:
> >>
> >>>   Hello,
> >>> I was trying to utilize PerfSonarUI to see how my dataset 
> >> looks like 
> >>> but its got only empty list.  Its perfSONAR 1.0.  I can see 
> >> requests 
> >>> but it seems like there is nothing is found:
> >>>
> >>> 2006-09-14 18:02:49,583 DEBUG - ExistXMLDatabaseAccess: 
> >> perform XQuery
> >>> 2006-09-14 18:02:49,583 DEBUG - ExistDbXmlDataRepository: connect
> >>> 2006-09-14 18:02:49,633 DEBUG - 
> >> RRDConfigurationStorageManager.fetch:  
> >>> Nr of fetched metadata blocks: 0
> >>> 2006-09-14 18:02:49,633 DEBUG - RRDTypeMAServiceEngine.takeAction:
> >>> Responding to request of type: GET_DATA
> >>> 2006-09-14 18:02:49,675 DEBUG - RequestHandler: Calling on 
> >> parser to 
> >>> parse the request
> >>> 2006-09-14 18:02:49,691 DEBUG - RequestHandler: Trying to 
> retrieve 
> >>> Message object from Handler
> >>> 2006-09-14 18:02:49,691 DEBUG - MessageHandlerFactory: 
> >> classname asked 
> >>> for is  org.perfsonar.commons.messages.SetupDataRequest
> >>> 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> >>> initComponent
> >>> 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: read 
> >>> properties from configuration component
> >>> 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> >> read DB URI 
> >>> property = [component.ma.xmldb.db_uri]
> >>> 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> >> read DB URI 
> >>> property = [component.ma.xmldb.db_username]
> >>> 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> >> read DB URI 
> >>> property = [component.ma.xmldb.db_password]
> >>> 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: create 
> >>>
> >> 
> ExistDbXmlDataRepository(xmldb:exist://localhost:8680/exist/xmlrpc/db/
> >>> rrdmac
> >>> onfig, rrdmaservice, rrdmaservice)
> >>> 2006-09-14 18:02:49,693 DEBUG - XmlDbDataRepository: created
> >>> 2006-09-14 18:02:49,693 DEBUG - ExistDbXmlStorageManager: 
> >> initStorage 
> >>> with data repository
> >>> 2006-09-14 18:02:49,693 DEBUG - 
> RRDTypeMAServiceEngine.takeAction: 
> >>> Received a request of type - GET_DATA
> >>> 2006-09-14 18:02:49,693 DEBUG - Transformations.getMetadataQuery: 
> >>> start getMetadataQuery
> >>> 2006-09-14 18:02:49,693 DEBUG - 
> >> Transformations.getMetadataQuery: meta
> >>> query:
> >>>
> >> 
> //*:eventType[text()='utilization']/parent::*//*:direction[text()='out
> >>> ']/par
> >>> ent::*/parent::*/parent::*
> >>> 2006-09-14 18:02:49,694 DEBUG - ExistXMLDatabaseAccess: 
> >> perform XQuery
> >>> 2006-09-14 18:02:49,694 DEBUG - ExistDbXmlDataRepository: connect
> >>> 2006-09-14 18:02:49,741 DEBUG - 
> >> RRDConfigurationStorageManager.fetch:  
> >>> Nr of fetched metadata blocks: 0
> >>> 2006-09-14 18:02:49,741 DEBUG - RRDTypeMAServiceEngine.takeAction:
> >>> Responding to request of type: GET_DATA
> >>> 2006-09-14 18:03:08,830 DEBUG - 
> >> RRDTypeMAServiceLSRegistrationComponent:
> >>> register to LS 
> >>> [http://loco4.man.poznan.pl:8090/axis/services/LookupService]
> >>> with file [/home/netadmin/perfSONAR/conf/fermilab_ma.xml]
> >>>
> >>> Any reccomendations where should I look ?
> >>> Thanks,
> >>>           Maxim Grigoriev
> >>>           Fermilab
> >>>
> >>>
> >>
> >>
> >>
> > 
> > 
> > 
> 
> 
>