perfSONAR User Q&A and Other Discussion

[Nina Jeliazkova <>]

Piotr,

It's known for a while that the problem is on both sides. With more than
couple of hundred interfaces RRD MA becomes pretty slow (I don't have
experience with SQL MA).

On the other hand, with huge amount of data (either many interfaces or
frequent measurements), the XML messages are becoming huge, and due to
psUI handling them via DOM in memory, these messages occupy at least
twice more memory than the original XML.  This have been discussed many
times during GN2.  Suggested workarounds are abandoning DOM, local
caching of the received data, or even finding more efficient mechanism
than XML.

Of course the easiest workaround is to allocate more memory to the java VM.

Hope this helps,
Nina

Piotr Pikusa wrote:
> Thank you Ralph for this information. It concerns psUI rather than
> SQL-MA but it seems to be a serious bug. I'm working on developing
> performance test which find a bottle neck and I will give you a
> feedback as I will have the results.
>
> Nina, can you tell anything more about  psUI performance?
>
>
> Cheers
> Piotr Pikusa
> PSNC
>
> Niederberger, Ralph wrote:
>> Dear Peter and Piotr,
>>
>> I see similar problems with the SQLMA.
>> When using perfsonarUI 0.15b and asking for information (1 week) on a
>> specific interface (we have only 11 of them within the database), it
>> takes
>> more than 3 minutes to tell me that there is a "java heap space"
>> problem.
>> After clicking "OK", the client and my PC hangs.
>>
>> I do not have the problem if I request for 15 or 90 minutes or 8 to
>> 24 hour
>> intervals.
>> IMHO, those problems seem to be related to too much data (as you have
>> 740
>> interfaces, we have only 11, but are storing data every 30 seconds).
>>
>> I do not see the problems within my SQLMA logs. The difference I see is:
>> - when requesting short period information there are 3 requests logged.
>> - when trying long periods, i.e. the client hangs, there is only one
>> request
>> logged.
>>
>> ==============Request which worked well =======
>> 2009-11-04 10:32:09,702 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         received a request
>> 2009-11-04 10:32:13,269 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         sent a successful response
>> 2009-11-04 10:32:13,269 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>> message                         type=[SetupDataRequest]
>> id=[message1257327128] is                         [00]min [03]secs
>> [567]milisec
>> 2009-11-04 10:32:13,522 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         received a request
>> 2009-11-04 10:32:16,940 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         sent a successful response
>> 2009-11-04 10:32:16,940 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>> message                         type=[SetupDataRequest]
>> id=[message1257327132] is                         [00]min [03]secs
>> [418]milisec
>> 2009-11-04 10:32:47,494 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         received a request
>> 2009-11-04 10:32:54,946 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         sent a successful response
>> 2009-11-04 10:32:54,946 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>> message                         type=[SetupDataRequest]
>> id=[message1257327166] is                         [00]min [07]secs
>> [452]milisec
>> ============= Request which got wrong ==========
>> 2009-11-04 10:37:27,346 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         received a request
>> 2009-11-04 10:37:34,581 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>> Service                         sent a successful response
>> 2009-11-04 10:37:34,582 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>> message                         type=[SetupDataRequest]
>> id=[message1257327372] is                         [00]min [07]secs
>> [236]milisec
>> ================================================
>>
>> Any hints from the group?
>>
>> And by the way, there is a bug with the log messages also. They
>> should be
>> changed for SQLMA to "%GEANT2-JAVA-SQL-MA.INFO% ..."
>>
>> Best regards
>>
>> Ralph
>>
>> ***************************************************
>>  Ralph Niederberger
>>  Juelich Supercomputing Centre
>>  Institute for Advanced Simulation
>>
>>  Phone:  +49 2461 61-4772
>>  Fax:    +49 2461 61-6656
>>  E-Mail: 
>> 
>>  WWW:    http://www.fz-juelich.de/jsc/
>>
>>  JSC is the coordinator of the
>>  John von Neumann Institute for Computing
>>  and member of the
>>  Gauss Centre for Supercomputing
>> ***************************************************
>>
>>  Forschungszentrum Jülich GmbH
>>  52425 Jülich
>>
>>  Sitz der Gesellschaft: Jülich
>>  Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498
>>  Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe
>>  Geschäftsführung: Prof. Dr. Achim Bachem (Vorsitzender),
>>  Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
>>  Prof. Dr. Sebastian M. Schmidt
>> ***************************************************
>>
>>
>>  
>>> -----Ursprüngliche Nachricht-----
>>> Von: P.Heiligers 
>>> [mailto:]
>>> Gesendet: Mittwoch, 4. November 2009 09:57
>>> An: 
>>> 
>>> Cc: DFN-NOC
>>> Betreff: [perfsonar-user] Performance Problem :
>>> perfsonar-java-rrd-ma 3.2
>>>
>>> Dear all,
>>>
>>> my name is Peter from DFN-NOC Stuttgart, we have a perfsonar RRDMA 3.2
>>> installation running  on a Intel Xeon
>>> machine with debian linux.
>>>
>>> Installed is:
>>>
>>> ii  perfsonar-java-rrd-ma
>>> 3.2                          perfSONAR Round Robin Database
>>>
>>> We are experiencing timeouts and long delays from PerfsonarUI and other
>>> tools used by colleagues , accessing the RRDMA.
>>> Our RRDMA contains 740 interfaces right now. The Log data shown are in
>>> response to a PerfsonarUI metrics query. As you see, requests are
>>> serviced after more than 6 minutes. Almost any application is timed out
>>> than.
>>> What is happening here, any idea ? A problem with the exist database ?
>>> As one finds this in the log:
>>>
>>> 2009-11-03 18:52:58,640 %GEANT2-JAVA-RRD-MA.ERROR%
>>> MetadataConfigurationStorageManager.executeQuery: Connection to xml
>>> database failed: org.perfsonar.base.exceptions.PerfSONARException:
>>> [error.common.storage.xmldb.query]: Can't perform XQuery:
>>> java.lang.NullPointerException
>>>
>>> Are there simply too many interfaces in the system ?
>>>
>>>
>>>
>>> With best regards, Peter Heiligers
>>>
>>>
>>>
>>>
>>>
>>>
>>> DFN VEREIN                      Network Operation Center
>>> eMail: 
>>> 
>>>            http://www.dfn.de/
>>> Phone: +49(0)711-63314-112      Fax: +49(0)711-63314-133
>>>
>>> Fehlermanagement 24x7           Trouble Ticket System (TTS)
>>> Phone: +49(0)1805-008447        https://tts-xwin.dfn.de
>>>
>>>
>>>
>>>
>>>
>>> 2009-11-03 18:43:51,692 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:04,509 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[1257270227] is [00]min [16]secs
>>> [271]milisec
>>> 2009-11-03 18:44:08,461 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,496 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,535 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,584 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,604 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,632 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,633 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,669 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,680 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,716 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,727 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,747 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,766 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,784 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,813 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,827 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,840 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,878 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:08,893 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,392 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,392 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,399 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,407 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,407 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,454 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,462 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,477 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,519 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,523 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,542 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,556 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,586 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,606 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,622 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,650 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,667 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,684 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,707 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,726 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,751 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,767 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,783 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,827 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,832 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:09,853 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:10,223 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:44:10,223 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:45:15,810 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:45:21,085 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:45:33,452 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:45:33,453 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [12]secs
>>> [367]milisec
>>> 2009-11-03 18:45:37,103 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:45:56,200 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:45:56,200 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [19]secs
>>> [097]milisec
>>> 2009-11-03 18:46:00,584 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:46:04,742 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:46:14,290 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:46:14,291 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [09]secs
>>> [548]milisec
>>> 2009-11-03 18:46:25,914 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:46:25,914 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [25]secs
>>> [330]milisec
>>> 2009-11-03 18:47:05,802 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:47:13,454 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:47:27,647 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:47:27,647 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [21]secs
>>> [845]milisec
>>> 2009-11-03 18:47:32,477 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest]
>>> id=[localhost.-35fa2506:124bb21e04b:3f6b] is [02]min [16]secs
>>> [667]milisec
>>>
>>> 2009-11-03 18:47:34,669 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:47:34,669 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [03]min
>>> [24]secs [446]milisec
>>> 2009-11-03 18:47:42,134 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:47:49,425 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:48:01,002 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:48:02,825 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:48:02,826 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [20]secs
>>> [691]milisec
>>> 2009-11-03 18:48:09,803 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:48:09,803 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [20]secs
>>> [378]milisec
>>> 2009-11-03 18:48:13,920 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:48:54,683 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:48:54,684 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270493] is [00]min
>>> [40]secs [763]milisec
>>> 2009-11-03 18:49:37,197 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:49:37,198 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [05]min
>>> [27]secs [611]milisec
>>> 2009-11-03 18:49:56,394 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:49:56,394 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [05]min
>>> [47]secs [810]milisec
>>> 2009-11-03 18:49:56,435 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:49:56,436 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [05]min
>>> [47]secs [595]milisec
>>> 2009-11-03 18:50:02,553 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:50:02,820 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:02,821 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [05]min
>>> [54]secs [140]milisec
>>> 2009-11-03 18:50:10,359 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:50:12,689 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:50:18,001 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:18,001 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [09]secs [369]milisec
>>> 2009-11-03 18:50:18,042 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:18,042 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [08]secs [523]milisec
>>> 2009-11-03 18:50:18,475 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:18,475 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [09]secs [871]milisec
>>> 2009-11-03 18:50:21,904 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:21,904 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [13]secs [188]milisec
>>> 2009-11-03 18:50:22,235 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:22,235 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [12]secs [712]milisec
>>> 2009-11-03 18:50:26,398 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:26,403 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [16]secs [949]milisec
>>> 2009-11-03 18:50:26,857 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:26,858 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [16]secs
>>> [498]milisec
>>> 2009-11-03 18:50:26,876 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:26,876 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest] id=[msg1] is [00]min [24]secs
>>> [323]milisec
>>> 2009-11-03 18:50:27,063 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:27,063 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [18]secs [279]milisec
>>> 2009-11-03 18:50:28,970 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:28,971 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [20]secs [338]milisec
>>> 2009-11-03 18:50:30,077 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:30,077 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [20]secs [670]milisec
>>> 2009-11-03 18:50:32,110 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:32,110 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [22]secs [278]milisec
>>> 2009-11-03 18:50:32,112 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:32,112 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [22]secs [345]milisec
>>> 2009-11-03 18:50:33,614 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:33,614 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [24]secs [801]milisec
>>> 2009-11-03 18:50:36,234 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:36,234 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [26]secs [757]milisec
>>> 2009-11-03 18:50:37,846 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:37,846 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [29]secs [119]milisec
>>> 2009-11-03 18:50:38,011 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:50:41,712 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:41,712 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [31]secs [859]milisec
>>> 2009-11-03 18:50:43,814 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:43,815 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [35]secs [146]milisec
>>> 2009-11-03 18:50:44,177 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:44,177 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [34]secs [785]milisec
>>> 2009-11-03 18:50:46,482 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:46,482 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [36]secs [876]milisec
>>> 2009-11-03 18:50:46,506 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:46,506 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [37]secs [613]milisec
>>> 2009-11-03 18:50:46,696 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:46,696 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [37]secs [297]milisec
>>> 2009-11-03 18:50:47,711 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:47,711 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [38]secs [044]milisec
>>> 2009-11-03 18:50:48,450 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:48,451 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [39]secs [989]milisec
>>> 2009-11-03 18:50:48,683 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:48,683 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [40]secs [148]milisec
>>> 2009-11-03 18:50:48,802 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:48,802 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [39]secs [095]milisec
>>> 2009-11-03 18:50:49,952 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:49,952 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [41]secs [186]milisec
>>> 2009-11-03 18:50:50,301 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:50,302 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [41]secs [554]milisec
>>> 2009-11-03 18:50:53,359 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:53,359 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [43]secs [576]milisec
>>> 2009-11-03 18:50:56,258 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:56,258 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [46]secs [636]milisec
>>> 2009-11-03 18:50:56,265 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:56,265 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [47]secs [438]milisec
>>> 2009-11-03 18:50:56,530 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:56,531 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [46]secs [703]milisec
>>> 2009-11-03 18:50:57,004 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:57,005 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [47]secs [612]milisec
>>> 2009-11-03 18:50:57,024 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:57,024 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [47]secs [468]milisec
>>> 2009-11-03 18:50:58,655 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:58,655 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [49]secs [248]milisec
>>> 2009-11-03 18:50:58,880 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:58,880 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [49]secs [129]milisec
>>> 2009-11-03 18:50:59,284 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:59,284 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [49]secs [742]milisec
>>> 2009-11-03 18:50:59,577 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:59,577 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [51]secs [081]milisec
>>> 2009-11-03 18:50:59,589 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:50:59,589 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [49]secs [939]milisec
>>> 2009-11-03 18:51:01,355 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:51:01,355 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270248] is [06]min
>>> [52]secs [477]milisec
>>> 2009-11-03 18:51:01,360 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:51:01,360 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [51]secs [137]milisec
>>> 2009-11-03 18:51:01,706 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:51:01,707 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [52]secs [022]milisec
>>> 2009-11-03 18:51:03,727 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:51:03,727 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [54]secs [001]milisec
>>> 2009-11-03 18:51:04,191 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:51:04,192 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest] id=[message1257270249] is [06]min
>>> [54]secs [729]milisec
>>> 2009-11-03 18:51:05,740 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:51:05,741 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb21e04b:-1b6c] is [07]min [14]secs
>>> [048]milisec
>>>
>>> 2009-11-03 18:51:06,382 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[MetadataKeyRequest]
>>> id=[localhost.-35fa2506:124bb294424:-5ad5] is [00]min [53]secs
>>> [693]milisec
>>>
>>> 2009-11-03 18:51:24,775 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:51:46,557 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a
>>> request
>>> 2009-11-03 18:51:49,525 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful
>>> response
>>> 2009-11-03 18:51:49,525 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb21e04b:77d2] is [03]min [48]secs
>>> [523]milisec
>>> 2009-11-03 18:51:51,145 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful response
>>> 2009-11-03 18:51:51,145 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb21e04b:6606] is [04]min [37]secs
>>> [691]milisec
>>> 2009-11-03 18:51:56,616 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful response
>>> 2009-11-03 18:51:56,617 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb294424:-5202] is [01]min [18]secs
>>> [606]milisec
>>> 2009-11-03 18:51:58,355 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a request
>>> 2009-11-03 18:52:36,709 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful response
>>> 2009-11-03 18:52:36,710 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb294424:-384d] is [01]min [11]secs
>>> [934]milisec
>>> 2009-11-03 18:52:38,439 %GEANT2-JAVA-RRD-MA.ERROR%
>>> MetadataConfigurationStorageManager.executeQuery: Connection to xml
>>> database failed: org.perfsonar.base.exceptions.PerfSONARException:
>>> [error.common.storage.xmldb.query]: Can't perform XQuery:
>>> java.lang.NullPointerException
>>> 2009-11-03 18:52:43,077 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful response
>>> 2009-11-03 18:52:43,077 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb294424:-29e9] is [00]min [56]secs
>>> [520]milisec
>>> 2009-11-03 18:52:44,933 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a request
>>> 2009-11-03 18:52:48,504 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful response
>>> 2009-11-03 18:52:48,505 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb294424:-1f75] is [00]min [50]secs
>>> [149]milisec
>>> 2009-11-03 18:52:50,194 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a request
>>> 2009-11-03 18:52:58,640 %GEANT2-JAVA-RRD-MA.ERROR%
>>> MetadataConfigurationStorageManager.executeQuery: Connection to xml
>>> database failed: org.perfsonar.base.exceptions.PerfSONARException:
>>> [error.common.storage.xmldb.query]: Can't perform XQuery:
>>> java.lang.NullPointerException
>>> 2009-11-03 18:53:11,051 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful response
>>> 2009-11-03 18:53:11,051 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of
>>> message type=[SetupDataRequest]
>>> id=[localhost.-35fa2506:124bb294424:-a4d] is [00]min [26]secs
>>> [118]milisec
>>> 2009-11-03 18:53:13,005 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service received a request
>>> 2009-11-03 18:53:15,939 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler:
>>> Service sent a successful response
>>>
>>>     
>>
>>