perfSONAR User Q&A and Other Discussion

[maxim <>]

Thanks, Vedrin,
After more tips from Joe and you I was able to start it finally...sigh.
RRD MA service is running and showing data ( I called it utilization but its
ifIn(Out)Octets indeed).
Btw, there was no any indication that rrdjtool is needed , although it was
supplied in contrib
directory ( but was not in any of required CLASPATHes) so I've added it too
and then everything started to work.
Also,there is no way to install Axis 1.2.1, please fix this in your
installation 
instructions , only Axis 1.4 is available.
Also, please provide script to configure eXist properly without need to use
GUI, it complicates things
and small typo will waste a lot of time.
thanks,
          Maxim. 

> -----Original Message-----
> From: Vedrin Jeliazkov 
> [mailto:]
>  
> Sent: Friday, September 15, 2006 12:57 PM
> To: maxim
> Cc: 
> ;
>  
> 
> Subject: Re: [perfsonar-user] emty data
> 
> Hi Maxim,
> 
> After a quick look at your MA config file, I already have an 
> idea what might be wrong. You mentioned that you've installed 
> the perfSONAR-1.0 version of RRD MA. In this case perfsonarUI 
> (and maybe the service as well) expects the old syntax for 
> "eventType", rather than "supportedEventType". The later was 
> introduced in newer versions of the service and will work 
> only with them AFAIK. So basically, you'll have to replace
> 
> <nmwg:parameters>
> <nmwg:parameter name="supportedEventType">utilization</nmwg:parameter>
> </nmwg:parameters>
> 
> with the older
> 
> <nmwg:eventType>utilization</nmwg:eventType>
> 
> for all interfaces in your config. Let me know if this 
> solution solves the problem.
> 
> I guess the following page should be updated with this info 
> (at least for the time being):
> 
> http://wiki.perfsonar.net/jra1-wiki/index.php/RRD_description_file
> 
> I've been confronted with a similar problem a few weeks ago, 
> while upgrading ISTF's RRD MA to SVN version.
> 
> Best regards,
> Vedrin
> 
> PS: I'm not sure if this is (only) a service related issue. 
> At present perfsonarUI doesn't know anything about the 
> "supportedEventType" flavour, but still works fine with newer 
> (than perfSONAR-1.0) services if they're configured that way. 
> However, we'll certainly try to implement a better solution 
> for "supportedEventType" in the upcoming releases of perfsonarUI.
> 
> maxim 
> <>
>  wrote:
> 
> > hmm, that’s strange. How can I debug it and find where the culprit ?
> > the MA config file is below.
> > Thanks,
> >          Maxim.
> >  <?xml version="1.0" encoding="UTF-8"?>
> > 
> > 
> > <!-- 
> > ===================================================================
> > <description>
> >    MA RRD configuration file
> > 
> >    $Id: fermilab_ma.xml,v 1.10 2005/10/25 05:39:08 zurawski Exp $
> >    project: perfSONAR
> > 
> > Notes:
> >    This is the configuration file which contains the information 
> >    about RRD files from  Fermilab
> > 
> > </description>
> > 
> ==================================================================== 
> > -->
> > 
> > <nmwg:store xmlns="http://ggf.org/ns/nmwg/base/2.0/"; 
> >                  xmlns:nmwg="http://ggf.org/ns/nmwg/base/2.0/"; 
> >  
> > 
> xmlns:netutil="http://ggf.org/ns/nmwg/characteristic/utilizati
> on/2.0/" 
> >                  xmlns:nmwgt="http://ggf.org/ns/nmwg/topology/2.0/";>
> >                  
> >                  <!--  metadata section  -->
> > 
> >        <nmwg:metadata id="meta1">
> >          <netutil:subject id="subj1">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet2_2</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Link to lhcopnmon1 
> monitoring 
> > host</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data1" metadataIdRef="meta1">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-interfac
> > es/ten gigabitethernet2_2.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> >   <nmwg:metadata id="meta2">
> >          <netutil:subject id="subj2">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet2_2</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Link to lhcopnmon1 
> monitoring 
> > host</nmwgt:ifDescription>
> >                    <nmwgt:direction>out</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data2" metadataIdRef="meta2">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-interfac
> > es/ten gigabitethernet2_2.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds1</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> > 
> >        <nmwg:metadata id="meta3">
> >          <netutil:subject id="subj3">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet3_4</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink 10G to 
> > core</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data3" metadataIdRef="meta3">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-interfac
> > es/ten gigabitethernet3_4.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > ifAddress type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet3_4</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink 10G to 
> > core</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data3" metadataIdRef="meta3">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-interfac
> > es/ten gigabitethernet3_4.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> > 
> >        <nmwg:metadata id="meta4">
> >          <netutil:subject id="subj4">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet3_4</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink 10G to 
> > core</nmwgt:ifDescription>
> >                    <nmwgt:direction>out</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data4" metadataIdRef="meta4">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-interfac
> > es/ten gigabitethernet3_4.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds1</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> > 
> >        <nmwg:metadata id="meta5">
> >          <netutil:subject id="subj5">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet1_1</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink to 
> > Starlight</nmwgt:ifDescription>
> >                    <nmwgt:direction>in</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data5" metadataIdRef="meta5">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-interfac
> > es/ten gigabitethernet1_1.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds0</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> >         <nmwg:metadata id="meta6">
> >          <netutil:subject id="subj6">
> >                <nmwgt:interface> 
> >                   <nmwgt:hostName>r-cms-fcc2</nmwgt:hostName>
> >                    <nmwgt:ifAddress
> > type="ipv4">172.16.12.1</nmwgt:ifAddress>
> >                    
> <nmwgt:ifName>tengigabitethernet1_1</nmwgt:ifName>
> >                    <nmwgt:ifDescription>Uplink to 
> > Starlight</nmwgt:ifDescription>
> >                    <nmwgt:direction>out</nmwgt:direction>
> >                    <nmwgt:authRealm>Fermilab</nmwgt:authRealm>
> >                </nmwgt:interface>
> >              </netutil:subject>
> >             <nmwg:parameters>
> >                    <nmwg:parameter
> > name="supportedEventType">utilization</nmwg:parameter>
> >           </nmwg:parameters>
> >         </nmwg:metadata>
> >           <nmwg:data id="data6" metadataIdRef="meta6">
> >            <nmwg:key>
> >                <nmwg:parameters>
> >                    <nmwg:parameter
> > 
> name="file">/home/netadmin/LHCOPN/cricket/cricket-data/router-interfac
> > es/ten gigabitethernet1_1.rrd</nmwg:parameter>
> >                    <nmwg:parameter 
> name="dataSource">ds1</nmwg:parameter>
> >                    <nmwg:parameter name="unit">bps</nmwg:parameter> 
> >                </nmwg:parameters>
> >            </nmwg:key>
> >         </nmwg:data>
> > 
> >         </nmwg:store>
> > > -----Original Message-----
> > > From: Vedrin Jeliazkov 
> > > [mailto:]
> > > Sent: Friday, September 15, 2006 2:23 AM
> > > To: maxim
> > > Cc: 
> > > 
> > > Subject: Re: [perfsonar-user] emty data
> > > 
> > > Hi Maxim,
> > > 
> > > After launching perfsonarUI in debug mode we found that 
> your service 
> > > returns an empty reply to the MetadataKeyRequest, which 
> is used to 
> > > fetch the list of
> > > interfaces:
> > > 
> > > 2006-09-15 10:12:54,437 [Thread-2] DEBUG
> > > org.perfsonar.client.ma.MARequest2 - Sending request to 
> > > FERMILAB,http://lhcopnmon1-mgm.fnal.gov:8080/axis/services/Mea
> > > surementArchiveService,NMWG2v2_netutil
> > > 2006-09-15 10:12:54,468 [Thread-2] DEBUG
> > > org.perfsonar.client.ma.MARequest2 - <nmwg:message id="1" 
> > > type="MetadataKeyRequest"
> > > 
> xmlns:netutil="http://ggf.org/ns/nmwg/characteristic/utilization/2.0/";
> > > xmlns:nmwg="http://ggf.org/ns/nmwg/base/2.0/";
> > > xmlns:nmwgt="http://ggf.org/ns/nmwg/topology/2.0/";
> > > 
> xmlns:select="http://ggf.org/ns/nmwg/ops/select/2.0/";><nmwg:metadata
> > > id="meta1"><netutil:subject
> > > id="iusub1"><nmwgt:interface/></netutil:subject><nmwg:eventTyp
> > > e>utilization</nmwg:eventType></nmwg:metadata><nmwg:data
> > > id="data1" metadataIdRef="meta1"/></nmwg:message>
> > > 2006-09-15 10:12:56,390 [Thread-2] DEBUG
> > > org.perfsonar.client.ma.MARequest2 - Sent query using AXIS...
> > > 
> > > 2006-09-15 10:12:56,390 [Thread-2] DEBUG
> > > org.perfsonar.client.ma.MARequest2 - Received answer (?)...
> > > 
> > > 2006-09-15 10:12:56,406 [Thread-2] DEBUG
> > > org.perfsonar.client.ma.MARequest2 - <?xml version="1.0" 
> > > encoding="UTF-8"?> <nmwg:message
> > > xmlns:nmwg="http://ggf.org/ns/nmwg/base/2.0/";
> > > id="localhost.localdomain.-326c70b0:10dae9055bd:70ef" />
> > > 
> > > 2006-09-15 10:12:56,421 [Thread-2] INFO
> > > org.perfsonar.client.ma.MARequest2 - Client exiting
> > > 
> > > It looks like the service doesn't know about any interfaces...
> > > 
> > > Best regards,
> > > Vedrin
> > > 
> > > PS: Debug mode in perfsonarUI can be enabled by executing the 
> > > following
> > > command:
> > > 
> > > java -Dperfsonar.debugging=true -jar perfSonarApp.jar
> > > 
> > > maxim 
> > > <>
> > >  wrote:
> > > 
> > > >   Hello,
> > > > I was trying to utilize PerfSonarUI to see how my dataset
> > > looks like
> > > > but its got only empty list.  Its perfSONAR 1.0.  I can see
> > > requests
> > > > but it seems like there is nothing is found:
> > > > 
> > > > 2006-09-14 18:02:49,583 DEBUG - ExistXMLDatabaseAccess: 
> > > perform XQuery
> > > > 2006-09-14 18:02:49,583 DEBUG - 
> ExistDbXmlDataRepository: connect
> > > > 2006-09-14 18:02:49,633 DEBUG -
> > > RRDConfigurationStorageManager.fetch:  
> > > > Nr of fetched metadata blocks: 0
> > > > 2006-09-14 18:02:49,633 DEBUG - 
> RRDTypeMAServiceEngine.takeAction:
> > > > Responding to request of type: GET_DATA
> > > > 2006-09-14 18:02:49,675 DEBUG - RequestHandler: Calling on
> > > parser to
> > > > parse the request
> > > > 2006-09-14 18:02:49,691 DEBUG - RequestHandler: Trying 
> to retrieve 
> > > > Message object from Handler
> > > > 2006-09-14 18:02:49,691 DEBUG - MessageHandlerFactory: 
> > > classname asked
> > > > for is  org.perfsonar.commons.messages.SetupDataRequest
> > > > 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> > > > initComponent
> > > > 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: read 
> > > > properties from configuration component
> > > > 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> > > read DB URI
> > > > property = [component.ma.xmldb.db_uri]
> > > > 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> > > read DB URI
> > > > property = [component.ma.xmldb.db_username]
> > > > 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: 
> > > read DB URI
> > > > property = [component.ma.xmldb.db_password]
> > > > 2006-09-14 18:02:49,692 DEBUG - ExistDbXmlStorageManager: create
> > > > 
> > > 
> ExistDbXmlDataRepository(xmldb:exist://localhost:8680/exist/xmlrpc/d
> > > b/
> > > > rrdmac
> > > > onfig, rrdmaservice, rrdmaservice)
> > > > 2006-09-14 18:02:49,693 DEBUG - XmlDbDataRepository: created
> > > > 2006-09-14 18:02:49,693 DEBUG - ExistDbXmlStorageManager: 
> > > initStorage
> > > > with data repository
> > > > 2006-09-14 18:02:49,693 DEBUG - 
> RRDTypeMAServiceEngine.takeAction: 
> > > > Received a request of type - GET_DATA
> > > > 2006-09-14 18:02:49,693 DEBUG - 
> Transformations.getMetadataQuery: 
> > > > start getMetadataQuery
> > > > 2006-09-14 18:02:49,693 DEBUG -
> > > Transformations.getMetadataQuery: meta
> > > > query:
> > > > 
> > > 
> //*:eventType[text()='utilization']/parent::*//*:direction[text()='o
> > > ut
> > > > ']/par
> > > > ent::*/parent::*/parent::*
> > > > 2006-09-14 18:02:49,694 DEBUG - ExistXMLDatabaseAccess: 
> > > perform XQuery
> > > > 2006-09-14 18:02:49,694 DEBUG - 
> ExistDbXmlDataRepository: connect
> > > > 2006-09-14 18:02:49,741 DEBUG -
> > > RRDConfigurationStorageManager.fetch:  
> > > > Nr of fetched metadata blocks: 0
> > > > 2006-09-14 18:02:49,741 DEBUG - 
> RRDTypeMAServiceEngine.takeAction:
> > > > Responding to request of type: GET_DATA
> > > > 2006-09-14 18:03:08,830 DEBUG -
> > > RRDTypeMAServiceLSRegistrationComponent:
> > > > register to LS
> > > > [http://loco4.man.poznan.pl:8090/axis/services/LookupService]
> > > > with file [/home/netadmin/perfSONAR/conf/fermilab_ma.xml]
> > > > 
> > > > Any reccomendations where should I look ?
> > > > Thanks,
> > > >           Maxim Grigoriev
> > > >           Fermilab
> > > > 
> > > > 
> > > 
> > > 
> > > 
> > > 
> > 
> > 
> > 
> 
> 
> 
>