perfSONAR User Q&A and Other Discussion

[Piotr Pikusa <>]

Hi Peter!

Thank you for another helpful tests! Could you also specify: does "load 
metadata" take 6 minutes or "load metrics"?  As a developer 
unfortunately I don't have such a great metadata file with a huge amount 
of interfaces. Could you please send me your metadata file? That would 
be very helpful and make solution faster to appear :)

Cheers
Piotr Pikusa

P.Heiligers wrote:
> Hello Szymon, Piotr, Ralph,.....
>
> The the queryintervall yesterday was for a period of a  bit more than 
> a day. Reading your replies, i shortend the
> query intervall down to a bit more than an hour.
> I do than a "load metadata" and afterwards "load metrics". This is 
> what  fails from perfsonarUI.
> This time there was no exist database error, i can't say if accessing 
> exist per web yesterday would have worked.
> The delay went again up to 6minutes.  Utilisation data  for interface 
> numbers  737-743, they are the last ones,
> are displayed. All other interface entries are empty.  Btw, we didn't 
> have this problem with 200+ interfaces.
> What can also be noticed is that the load on box rises from 1.5 up to 5
>
>
> This might be useful, looking at the exist database through the WEB 
> Interf. shows:
>
> Pool :  running : 10    available : 0     max: 20
>
> Find attached, pool and buffer data from exist db
>
>
>
> This is a part from the last logging in perfsonar.log:
>
>
> regards, Peter
>
>
>
>
> 2009-11-04 12:29:13,253 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:13,253 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333751] is [06]min [41]secs 
> [557]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:13,384 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:13,384 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333751] is [06]min [41]secs 
> [680]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:13,445 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:13,445 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333750] is [06]min [42]secs 
> [484]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:14,246 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:14,246 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333750] is [06]min [43]secs 
> [527]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:16,434 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:16,434 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333752] is [06]min [43]secs 
> [824]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:17,094 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:17,094 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333750] is [06]min [46]secs 
> [205]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:17,577 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:17,578 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333751] is [06]min [45]secs 
> [826]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:18,453 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:18,453 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333750] is [06]min [47]secs 
> [823]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:19,567 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:19,567 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333752] is [06]min [47]secs 
> [315]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:19,958 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:19,958 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: Service sent a 
> successful response                                                   
> 2009-11-04 12:29:19,958 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333751] is [06]min 
> [48]secs 
> [853]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:19,958 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333751] is [06]min 
> [48]secs 
> [407]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:20,192 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful 
> response                                                   2009-11-04 
> 12:29:20,193 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of message 
> type=[SetupDataRequest] id=[message1257333750] is [06]min [49]secs 
> [369]milisec                                                                                                                                                     
>
> 2009-11-04 12:29:21,483 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:21,484 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333750] is [06]min 
> [50]secs [619]milisec
> 2009-11-04 12:29:21,991 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:21,992 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333751] is [06]min 
> [49]secs [787]milisec
> 2009-11-04 12:29:22,226 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:22,226 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333750] is [06]min 
> [51]secs [231]milisec
> 2009-11-04 12:29:22,390 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:22,390 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333750] is [06]min 
> [51]secs [551]milisec
> 2009-11-04 12:29:22,479 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:22,479 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333751] is [06]min 
> [50]secs [862]milisec
> 2009-11-04 12:29:23,320 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:23,320 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] id=[message1257333750] is [06]min 
> [52]secs [341]milisec
> 2009-11-04 12:29:39,475 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:39,476 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bee8ac38:431c] is [06]min[03]secs [362]milisec
> 2009-11-04 12:29:42,401 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:29:42,401 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:-7a73] is [02]min [44]secs 
> [755]milisec
> 2009-11-04 12:29:44,144 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
> 2009-11-04 12:30:00,512 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:30:00,512 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:-3b95] is [00]min [16]secs 
> [368]milisec
> 2009-11-04 12:30:07,003 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
> 2009-11-04 12:30:24,844 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:30:24,845 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:-2f14] is [00]min [17]secs 
> [841]milisec
> 2009-11-04 12:30:28,405 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
> 2009-11-04 12:30:46,651 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:30:46,651 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:-2293] is [00]min [18]secs 
> [246]milisec
> 2009-11-04 12:30:52,434 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
> 2009-11-04 12:31:09,999 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:31:09,999 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:-1612] is [00]min [17]secs 
> [565]milisec
> 2009-11-04 12:31:11,729 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
> 2009-11-04 12:31:28,250 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:31:28,251 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:-991] is [00]min[16]secs [522]milisec
> 2009-11-04 12:31:30,625 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
> 2009-11-04 12:31:47,875 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:31:47,876 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:2f0] is [00]min [17]secs [250]milisec
> 2009-11-04 12:31:49,783 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
> 2009-11-04 12:32:06,697 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service sent a successful response
> 2009-11-04 12:32:06,697 %GEANT2-JAVA-RRD-MA.INFO% Execution Time of 
> message type=[SetupDataRequest] 
> id=[localhost.1c25217d:124bef24b0d:f71] is [00]min [16]secs [914]milisec
> 2009-11-04 12:32:08,318 %GEANT2-JAVA-RRD-MA.INFO% RequestHandler: 
> Service received a request
>
>
>
>
> Szymon Trocha wrote:
> > P.Heiligers pisze:
> > > Dear all,
> > >
> > > my name is Peter from DFN-NOC Stuttgart, we have a perfsonar RRDMA 
> > > 3.2 installation running  on a Intel Xeon
> > > machine with debian linux.
> > >
> > > Installed is:
> > >
> > > ii  perfsonar-java-rrd-ma                                   
> > > 3.2                          perfSONAR Round Robin Database
> > >
> > > We are experiencing timeouts and long delays from PerfsonarUI and 
> > > other tools used by colleagues , accessing the RRDMA.
> > > Our RRDMA contains 740 interfaces right now. The Log data shown are 
> > > in response to a PerfsonarUI metrics query. As you see, requests are 
> > > serviced after more than 6 minutes. Almost any application is timed 
> > > out than.
> > > What is happening here, any idea ? A problem with the exist database 
> > > ? As one finds this in the log:
> > >
> > > 2009-11-03 18:52:58,640 %GEANT2-JAVA-RRD-MA.ERROR% 
> > > MetadataConfigurationStorageManager.executeQuery: Connection to xml 
> > > database failed: org.perfsonar.base.exceptions.PerfSONARException: 
> > > [error.common.storage.xmldb.query]: Can't perform XQuery: 
> > > java.lang.NullPointerException
> > >
> > > Are there simply too many interfaces in the system ?
> >
> > Hi Peter,
> >
> > The above error seems to indicate failed connection to eXist. Does it 
> > work if you try to connect directly via browser?
> >
> > P.S. I know you didn't get the e-mail from the ML. You could use 
> >  next time I remember some problems in 
> > the past with the other adddress.
>
>
> ------------------------------------------------------------------------
>
>
> ------------------------------------------------------------------------