perfSONAR User Q&A and Other Discussion

[David Schmitz <>]

Hi Piotr,

> Thank you Ralph for this information. It concerns psUI rather than SQL-MA 
> but
> it seems to be a serious bug. I'm working on developing performance test 
> which
> find a bottle neck and I will give you a feedback as I will have the 
> results.
I am not sure whether this is only a problem with PSUI,
because our CNM RRDMA fetch scripts are also experiencing very high delay of 
response messages
from the DFN RRD MA:

Currently, this MA contains about 700 interfaces, i.e. about 1400
subjects (number of interfaces x 2 (in+out)).

A request for exactly 100 subjects (and a 5-minute time interval) 
takes currently about 18-19 seconds, which is relatively high.

Best Regards
David



> 
> Nina, can you tell anything more about  psUI performance?
> 
> 
> Cheers
> Piotr Pikusa
> PSNC
> 
> Niederberger, Ralph wrote:
> > Dear Peter and Piotr,
> >
> > I see similar problems with the SQLMA. 
> >
> > When using perfsonarUI 0.15b and asking for information (1 week) on a
> > specific interface (we have only 11 of them within the database), it takes
> > more than 3 minutes to tell me that there is a "java heap space" problem.
> > After clicking "OK", the client and my PC hangs.
> >
> > I do not have the problem if I request for 15 or 90 minutes or 8 to 24 
> > hour
> > intervals. 
> >
> > IMHO, those problems seem to be related to too much data (as you have 740
> > interfaces, we have only 11, but are storing data every 30 seconds).
> >
> > I do not see the problems within my SQLMA logs. The difference I see is:
> > - when requesting short period information there are 3 requests logged.
> > - when trying long periods, i.e. the client hangs, there is only one 
> > request
> > logged.
> >
> > ==============Request which worked well =======
> > 2009-11-04 10:32:09,702 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > received a request
> > 2009-11-04 10:32:13,269 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > sent a successful response
> > 2009-11-04 10:32:13,269 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> > message 
> >                         type=[SetupDataRequest] id=[message1257327128] is
> >                         [00]min [03]secs [567]milisec
> > 2009-11-04 10:32:13,522 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > received a request
> > 2009-11-04 10:32:16,940 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > sent a successful response
> > 2009-11-04 10:32:16,940 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> > message 
> >                         type=[SetupDataRequest] id=[message1257327132] is
> >                         [00]min [03]secs [418]milisec
> > 2009-11-04 10:32:47,494 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > received a request
> > 2009-11-04 10:32:54,946 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > sent a successful response
> > 2009-11-04 10:32:54,946 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> > message 
> >                         type=[SetupDataRequest] id=[message1257327166] is
> >                         [00]min [07]secs [452]milisec
> > ============= Request which got wrong ==========
> > 2009-11-04 10:37:27,346 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > received a request
> > 2009-11-04 10:37:34,581 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service
> > sent a successful response
> > 2009-11-04 10:37:34,582 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> > message 
> >                         type=[SetupDataRequest] id=[message1257327372] is
> >                         [00]min [07]secs [236]milisec
> > ================================================
> >
> > Any hints from the group?
> >
> > And by the way, there is a bug with the log messages also. They should be
> > changed for SQLMA to "%GEANT2-JAVA-SQL-MA.INFO% ..."
> >
> > Best regards
> >
> > Ralph
> >
> > ***************************************************
> >  Ralph Niederberger
> >  Juelich Supercomputing Centre
> >  Institute for Advanced Simulation
> >
> >  Phone:  +49 2461 61-4772
> >  Fax:    +49 2461 61-6656
> >  E-Mail: 
> > 
> >  WWW:    http://www.fz-juelich.de/jsc/
> >
> >  JSC is the coordinator of the
> >  John von Neumann Institute for Computing
> >  and member of the
> >  Gauss Centre for Supercomputing
> > ***************************************************
> >
> >  Forschungszentrum Jülich GmbH
> >  52425 Jülich
> >
> >  Sitz der Gesellschaft: Jülich
> >  Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498
> >  Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe
> >  Geschäftsführung: Prof. Dr. Achim Bachem (Vorsitzender),
> >  Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
> >  Prof. Dr. Sebastian M. Schmidt 
> >
> > ***************************************************
> >
> >
> >   
> > > -----Ursprüngliche Nachricht-----
> > > Von: P.Heiligers 
> > > [mailto:]
> > > Gesendet: Mittwoch, 4. November 2009 09:57
> > > An: 
> > > 
> > > Cc: DFN-NOC
> > > Betreff: [perfsonar-user] Performance Problem : perfsonar-java-rrd-ma 
> > > 3.2
> > >
> > > Dear all,
> > >
> > > my name is Peter from DFN-NOC Stuttgart, we have a perfsonar RRDMA 3.2
> > > installation running  on a Intel Xeon
> > > machine with debian linux.
> > >
> > > Installed is:
> > >
> > > ii  perfsonar-java-rrd-ma
> > > 3.2                          perfSONAR Round Robin Database
> > >
> > > We are experiencing timeouts and long delays from PerfsonarUI and other
> > > tools used by colleagues , accessing the RRDMA.
> > > Our RRDMA contains 740 interfaces right now. The Log data shown are in
> > > response to a PerfsonarUI metrics query. As you see, requests are
> > > serviced after more than 6 minutes. Almost any application is timed out
> > > than.
> > > What is happening here, any idea ? A problem with the exist database ?
> > > As one finds this in the log:
> > >
> > > 2009-11-03 18:52:58,640 %GEANT2-JAVA-RRD-MA.ERROR%
> > > MetadataConfigurationStorageManager.executeQuery: Connection to xml
> > > database failed: org.perfsonar.base.exceptions.PerfSONARException:
> > > [error.common.storage.xmldb.query]: Can't perform XQuery:
> > > java.lang.NullPointerException
> > >
> > > Are there simply too many interfaces in the system ?
> > >
> > >
> > >
> > > With best regards, Peter Heiligers
> > >
> > >
> > >
> > >
> > >
> > >
> > > DFN VEREIN                      Network Operation Center
> > > eMail: 
> > > 
> > >            http://www.dfn.de/
> > > Phone: +49(0)711-63314-112      Fax: +49(0)711-63314-133
> > >
> > > Fehlermanagement 24x7           Trouble Ticket System (TTS)
> > > Phone: +49(0)1805-008447        https://tts-xwin.dfn.de
> > >
> > >
> > >
> > >
> > >
> > > 2009-11-03 18:43:51,692 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:04,509 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[1257270227] is [00]min [16]secs
> > > [271]milisec
> > > 2009-11-03 18:44:08,461 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,496 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,535 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,584 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,604 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,632 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,633 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,669 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,680 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,716 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,727 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,747 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,766 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,784 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,813 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,827 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,840 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,878 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:08,893 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,392 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,392 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,399 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,407 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,407 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,454 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,462 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,477 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,519 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,523 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,542 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,556 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,586 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,606 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,622 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,650 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,667 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,684 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,707 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,726 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,751 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,767 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,783 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,827 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,832 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:09,853 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:10,223 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:44:10,223 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:45:15,810 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:45:21,085 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:45:33,452 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:45:33,453 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [12]secs
> > > [367]milisec
> > > 2009-11-03 18:45:37,103 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:45:56,200 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:45:56,200 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [19]secs
> > > [097]milisec
> > > 2009-11-03 18:46:00,584 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:46:04,742 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:46:14,290 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:46:14,291 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [09]secs
> > > [548]milisec
> > > 2009-11-03 18:46:25,914 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:46:25,914 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [25]secs
> > > [330]milisec
> > > 2009-11-03 18:47:05,802 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:47:13,454 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:47:27,647 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:47:27,647 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [21]secs
> > > [845]milisec
> > > 2009-11-03 18:47:32,477 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest]
> > > id=[localhost.-35fa2506:124bb21e04b:3f6b] is [02]min [16]secs
> > > [667]milisec
> > >
> > > 2009-11-03 18:47:34,669 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:47:34,669 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [03]min
> > > [24]secs [446]milisec
> > > 2009-11-03 18:47:42,134 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:47:49,425 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:48:01,002 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:48:02,825 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:48:02,826 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [20]secs
> > > [691]milisec
> > > 2009-11-03 18:48:09,803 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:48:09,803 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [20]secs
> > > [378]milisec
> > > 2009-11-03 18:48:13,920 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:48:54,683 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:48:54,684 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270493] is [00]min
> > > [40]secs [763]milisec
> > > 2009-11-03 18:49:37,197 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:49:37,198 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [05]min
> > > [27]secs [611]milisec
> > > 2009-11-03 18:49:56,394 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:49:56,394 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [05]min
> > > [47]secs [810]milisec
> > > 2009-11-03 18:49:56,435 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:49:56,436 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [05]min
> > > [47]secs [595]milisec
> > > 2009-11-03 18:50:02,553 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:50:02,820 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:02,821 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [05]min
> > > [54]secs [140]milisec
> > > 2009-11-03 18:50:10,359 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:50:12,689 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:50:18,001 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:18,001 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [09]secs [369]milisec
> > > 2009-11-03 18:50:18,042 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:18,042 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [08]secs [523]milisec
> > > 2009-11-03 18:50:18,475 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:18,475 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [09]secs [871]milisec
> > > 2009-11-03 18:50:21,904 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:21,904 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [13]secs [188]milisec
> > > 2009-11-03 18:50:22,235 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:22,235 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [12]secs [712]milisec
> > > 2009-11-03 18:50:26,398 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:26,403 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [16]secs [949]milisec
> > > 2009-11-03 18:50:26,857 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:26,858 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [16]secs
> > > [498]milisec
> > > 2009-11-03 18:50:26,876 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:26,876 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest] id=[msg1] is [00]min [24]secs
> > > [323]milisec
> > > 2009-11-03 18:50:27,063 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:27,063 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [18]secs [279]milisec
> > > 2009-11-03 18:50:28,970 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:28,971 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [20]secs [338]milisec
> > > 2009-11-03 18:50:30,077 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:30,077 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [20]secs [670]milisec
> > > 2009-11-03 18:50:32,110 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:32,110 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [22]secs [278]milisec
> > > 2009-11-03 18:50:32,112 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:32,112 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [22]secs [345]milisec
> > > 2009-11-03 18:50:33,614 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:33,614 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [24]secs [801]milisec
> > > 2009-11-03 18:50:36,234 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:36,234 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [26]secs [757]milisec
> > > 2009-11-03 18:50:37,846 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:37,846 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [29]secs [119]milisec
> > > 2009-11-03 18:50:38,011 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:50:41,712 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:41,712 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [31]secs [859]milisec
> > > 2009-11-03 18:50:43,814 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:43,815 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [35]secs [146]milisec
> > > 2009-11-03 18:50:44,177 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:44,177 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [34]secs [785]milisec
> > > 2009-11-03 18:50:46,482 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:46,482 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [36]secs [876]milisec
> > > 2009-11-03 18:50:46,506 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:46,506 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [37]secs [613]milisec
> > > 2009-11-03 18:50:46,696 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:46,696 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [37]secs [297]milisec
> > > 2009-11-03 18:50:47,711 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:47,711 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [38]secs [044]milisec
> > > 2009-11-03 18:50:48,450 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:48,451 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [39]secs [989]milisec
> > > 2009-11-03 18:50:48,683 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:48,683 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [40]secs [148]milisec
> > > 2009-11-03 18:50:48,802 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:48,802 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [39]secs [095]milisec
> > > 2009-11-03 18:50:49,952 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:49,952 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [41]secs [186]milisec
> > > 2009-11-03 18:50:50,301 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:50,302 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [41]secs [554]milisec
> > > 2009-11-03 18:50:53,359 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:53,359 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [43]secs [576]milisec
> > > 2009-11-03 18:50:56,258 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:56,258 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [46]secs [636]milisec
> > > 2009-11-03 18:50:56,265 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:56,265 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [47]secs [438]milisec
> > > 2009-11-03 18:50:56,530 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:56,531 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [46]secs [703]milisec
> > > 2009-11-03 18:50:57,004 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:57,005 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [47]secs [612]milisec
> > > 2009-11-03 18:50:57,024 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:57,024 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [47]secs [468]milisec
> > > 2009-11-03 18:50:58,655 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:58,655 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [49]secs [248]milisec
> > > 2009-11-03 18:50:58,880 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:58,880 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [49]secs [129]milisec
> > > 2009-11-03 18:50:59,284 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:59,284 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [49]secs [742]milisec
> > > 2009-11-03 18:50:59,577 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:59,577 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [51]secs [081]milisec
> > > 2009-11-03 18:50:59,589 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:50:59,589 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [49]secs [939]milisec
> > > 2009-11-03 18:51:01,355 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:51:01,355 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270248] is [06]min
> > > [52]secs [477]milisec
> > > 2009-11-03 18:51:01,360 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:51:01,360 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [51]secs [137]milisec
> > > 2009-11-03 18:51:01,706 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:51:01,707 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [52]secs [022]milisec
> > > 2009-11-03 18:51:03,727 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:51:03,727 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [54]secs [001]milisec
> > > 2009-11-03 18:51:04,191 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:51:04,192 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest] id=[message1257270249] is [06]min
> > > [54]secs [729]milisec
> > > 2009-11-03 18:51:05,740 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:51:05,741 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb21e04b:-1b6c] is [07]min [14]secs
> > > [048]milisec
> > >
> > > 2009-11-03 18:51:06,382 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[MetadataKeyRequest]
> > > id=[localhost.-35fa2506:124bb294424:-5ad5] is [00]min [53]secs
> > > [693]milisec
> > >
> > > 2009-11-03 18:51:24,775 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:51:46,557 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a
> > > request
> > > 2009-11-03 18:51:49,525 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful
> > > response
> > > 2009-11-03 18:51:49,525 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb21e04b:77d2] is [03]min [48]secs 
> > > [523]milisec
> > > 2009-11-03 18:51:51,145 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful response
> > > 2009-11-03 18:51:51,145 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb21e04b:6606] is [04]min [37]secs 
> > > [691]milisec
> > > 2009-11-03 18:51:56,616 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful response
> > > 2009-11-03 18:51:56,617 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb294424:-5202] is [01]min [18]secs
> > > [606]milisec
> > > 2009-11-03 18:51:58,355 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a request
> > > 2009-11-03 18:52:36,709 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful response
> > > 2009-11-03 18:52:36,710 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb294424:-384d] is [01]min [11]secs
> > > [934]milisec
> > > 2009-11-03 18:52:38,439 %GEANT2-JAVA-RRD-MA.ERROR%
> > > MetadataConfigurationStorageManager.executeQuery: Connection to xml
> > > database failed: org.perfsonar.base.exceptions.PerfSONARException:
> > > [error.common.storage.xmldb.query]: Can't perform XQuery:
> > > java.lang.NullPointerException
> > > 2009-11-03 18:52:43,077 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful response
> > > 2009-11-03 18:52:43,077 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb294424:-29e9] is [00]min [56]secs
> > > [520]milisec
> > > 2009-11-03 18:52:44,933 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a request
> > > 2009-11-03 18:52:48,504 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful response
> > > 2009-11-03 18:52:48,505 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb294424:-1f75] is [00]min [50]secs
> > > [149]milisec
> > > 2009-11-03 18:52:50,194 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a request
> > > 2009-11-03 18:52:58,640 %GEANT2-JAVA-RRD-MA.ERROR%
> > > MetadataConfigurationStorageManager.executeQuery: Connection to xml
> > > database failed: org.perfsonar.base.exceptions.PerfSONARException:
> > > [error.common.storage.xmldb.query]: Can't perform XQuery:
> > > java.lang.NullPointerException
> > > 2009-11-03 18:53:11,051 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful response
> > > 2009-11-03 18:53:11,051 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
> > > message type=[SetupDataRequest]
> > > id=[localhost.-35fa2506:124bb294424:-a4d] is [00]min [26]secs 
> > > [118]milisec
> > > 2009-11-03 18:53:13,005 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service received a request
> > > 2009-11-03 18:53:15,939 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
> > > Service sent a successful response
> > >
> > >     
> >
> >   
> 

-- 

David Schmitz

Boltzmannstraße 1, 85748 Garching
Telefon:   +49 89 35831-8765
Fax:       +49 89 35831-9700
Leibniz-Rechenzentrum, Germany
Mail: