perfSONAR User Q&A and Other Discussion

[Chris Welti <>]

Jeff W. Boote wrote:
> Chris Welti wrote:
> > SWITCH is currently using the python release.
> > I'm a bit reluctant to change to the java version as it seems to have 
> > a HUGE overhead. Also the performance of the python version seems better,
> > according to reports on this list.
>
> Well, I'm not sure which list you are talking about. Looking back, it 
> looks like the problems were reported on the user list, but the 
> resolution was only reported on the developers list. (Not good PR! :) ) 
> A good portion of the performance problems were fixed for the 1.0 
> production release by removing some debugging code. From Vedrin's 
> message to the list referring to the RC2 version that corrected these 
> issues:

Yes, I was reading about the performance issue on the user list. I don't have 
time to read all the messages on the dev list.
Good to hear that the performance has improved.

> | We noticed that Java RRD MA performance in processing 
> SetupDataRequests has
> | significantly improved, compared to RC1 (and Python RRD MA):
> |
> | 1 MetadataKeyRequest for 160 interfaces (Java)  ~  10 sec
> | 160 SetupDataREquests for 1 interface (Java)    ~  40 sec (!!!)
> |
> | 1 MetadataKeyRequest for 160 interfaces (Python)  ~  2.5 sec
> | 160 SetupDataREquests for 1 interface (Python)    ~  106 sec
> |
> | Java RRD MA now clearly outperforms Python RRD MA for SetupDataRequest
> | processing and completes the task 2.5 times faster on average (same 
> client,
> | same server, same data). However, the low MetadaKeyRequest processing
> | performance of Java RRD MA still remains an open issue.
>
> SetupDataRequests are the messages that actually fetch data. This is the 
> request that is duplicated - the MetadataKeyRequest is for the initial 
> metadata and does not need to be repeated very often by the client. So, 
> I would expect the Java performance to be superior for most uses of the 
> RRD MA. (This is not an exhaustive benchmark, so ymmv of course. But, 
> this is the data we have.)
>
> > As I understand, there needs to be plenty of installation works (Java, 
> > Apache, Tomcat/Axis, eXist) even before the perfSONAR java installation.
> > Is there a installation guide for this stuff?
>
> If the README is inadequate, we would appreciate any feedback you have. 
> (Perhaps we need to do something to let people know to look in the README?)

You should put a hyperlink to the README on the PerfSONAR page
http://monstera.man.poznan.pl/jra1-wiki/index.php/PerfSONAR_v1.0
under Pre-Installation Tasks

The way it is written now, I just assumed the README was referring to
a readme file of the tomcat/axis, exist etc. deployments.

> > On the www.perfsonar.net I can only find a guide for perfSONAR package
> > itself, but not the the pre-Install requirements :)
> > Keep in mind, I'm only a Network Engineer, not a Developer or Sys 
> > Admin :)
> > So until there is a real easy way to install it, or I get enough time 
> > on my hands to figure it out myself, the SWITCH RRD and ping MA will 
> > remain based on the python version.
>
> Then you are exactly the audience we need to support. We would benefit 
> greatly from any effort you are willing to put toward this. (Especially 
> if we can create some documentation to address each road block you hit - 
> as you hit it.)
>
> jeff

I succesfully installed java and also tomcat via apt-get (debian) 
I'm currently stuck trying to link axis into tomcat.
I only found the Version 1_4 of axis, as the hyperlink you have in your
readme to version 1_2_1 is not valid anymore.
Anyway, I think this should not be a problem, but it seems that Tomcat
doesn't like axis, as the following tomcat catalina log shows:

Aug 4, 2006 9:33:22 AM org.apache.coyote.http11.Http11Protocol pause
INFO: Pausing Coyote HTTP/1.1 on http-8180
Aug 4, 2006 9:33:23 AM org.apache.catalina.core.StandardService stop
INFO: Stopping service Tomcat-Standalone
Aug 4, 2006 9:33:23 AM org.apache.catalina.core.StandardHostDeployer remove
INFO: Removing web application at context path /axis
Aug 4, 2006 9:33:23 AM org.apache.catalina.core.StandardHostDeployer remove
INFO: Removing web application at context path 
Aug 4, 2006 9:33:23 AM org.apache.catalina.logger.LoggerBase stop
INFO: unregistering logger Catalina:type=Logger,host=localhost
Aug 4, 2006 9:33:23 AM org.apache.catalina.logger.LoggerBase stop
INFO: unregistering logger Catalina:type=Logger
Aug 4, 2006 9:33:23 AM org.apache.coyote.http11.Http11Protocol destroy
INFO: Stopping Coyote HTTP/1.1 on http-8180
Using CATALINA_BASE:   /var/lib/tomcat5
Using CATALINA_HOME:   /usr/share/tomcat5
Using CATALINA_TMPDIR: /var/lib/tomcat5/temp
Using JAVA_HOME:       /usr/lib/j2sdk1.5-sun
Using Security Manager
Aug 4, 2006 9:33:26 AM org.apache.coyote.http11.Http11Protocol init
INFO: Initializing Coyote HTTP/1.1 on http-8180
Aug 4, 2006 9:33:26 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 1112 ms
Aug 4, 2006 9:33:26 AM org.apache.catalina.core.StandardService start
INFO: Starting service Tomcat-Standalone
Aug 4, 2006 9:33:26 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/5.0
Aug 4, 2006 9:33:26 AM org.apache.catalina.core.StandardHost start
INFO: XML validation disabled
Aug 4, 2006 9:33:26 AM org.apache.catalina.core.StandardHost getDeployer
INFO: Create Host deployer for direct deployment ( non-jmx ) 
Aug 4, 2006 9:33:26 AM org.apache.catalina.core.StandardHostDeployer install
INFO: Processing Context configuration file URL 
file:/var/lib/tomcat5/conf/Catalina/localhost/axis.xml
Aug 4, 2006 9:33:27 AM org.apache.catalina.core.StandardContext listenerStart
SEVERE: Skipped installing application listeners due to previous error(s)
Aug 4, 2006 9:33:27 AM org.apache.catalina.core.StandardContext start
SEVERE: Error listenerStart
Aug 4, 2006 9:33:27 AM org.apache.catalina.core.StandardContext start
SEVERE: Context startup failed due to previous errors
Aug 4, 2006 9:33:27 AM org.apache.catalina.core.StandardHostDeployer install
INFO: Installing web application at context path  from URL 
file:/var/lib/tomcat5/webapps/ROOT
Aug 4, 2006 9:33:27 AM org.apache.coyote.http11.Http11Protocol start
INFO: Starting Coyote HTTP/1.1 on http-8180
Aug 4, 2006 9:33:27 AM org.apache.jk.common.ChannelSocket init
INFO: JK2: ajp13 listening on /0.0.0.0:8009
Aug 4, 2006 9:33:27 AM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=8/42  config=/var/lib/tomcat5/conf/jk2.properties
Aug 4, 2006 9:33:27 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 1253 ms

Note the SEVERE entries.
There might be a permissions issue as tomcat localhost log suggests:

2006-08-04 09:33:27 StandardContext[/axis]Error configuring application 
listener of class org.apache.axis.transport.http.AxisHTTPSessionListener
java.lang.ExceptionInInitializerError
       at org.apache.commons.discovery.jdk.JDKHooks.<clinit>(JDKHooks.java:75)
       at 
org.apache.commons.discovery.tools.DiscoverSingleton.find(DiscoverSingleton.java:412)
       at 
org.apache.commons.discovery.tools.DiscoverSingleton.find(DiscoverSingleton.java:378)
       at 
org.apache.axis.components.logger.LogFactory$1.run(LogFactory.java:45)
       at java.security.AccessController.doPrivileged(Native Method)
       at 
org.apache.axis.components.logger.LogFactory.getLogFactory(LogFactory.java:41)
       at 
org.apache.axis.components.logger.LogFactory.<clinit>(LogFactory.java:33)
       at 
org.apache.axis.transport.http.AxisHTTPSessionListener.<clinit>(AxisHTTPSessionListener.java:33)
       at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
Method)
       at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
       at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
       at java.lang.reflect.Constructor.newInstance(Constructor.java:494)
       at java.lang.Class.newInstance0(Class.java:350)
       at java.lang.Class.newInstance(Class.java:303)
       at 
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3780)
       at 
org.apache.catalina.core.StandardContext.start(StandardContext.java:4323)
       at 
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:823)
       at 
org.apache.catalina.core.ContainerBase.access$0(ContainerBase.java:811)
       at 
org.apache.catalina.core.ContainerBase$PrivilegedAddChild.run(ContainerBase.java:143)
       at java.security.AccessController.doPrivileged(Native Method)
       at 
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:805)
       at 
org.apache.catalina.core.StandardHost.addChild(StandardHost.java:595)
       at 
org.apache.catalina.core.StandardHostDeployer.addChild(StandardHostDeployer.java:903)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at 
org.apache.commons.beanutils.MethodUtils.invokeMethod(MethodUtils.java:216)
       at org.apache.commons.digester.SetNextRule.end(SetNextRule.java:216)
       at org.apache.commons.digester.Rule.end(Rule.java:230)
       at org.apache.commons.digester.Digester.endElement(Digester.java:1163)
       at 
org.apache.catalina.util.CatalinaDigester.endElement(CatalinaDigester.java:76)
       at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown 
Source)
       at 
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown 
Source)
       at 
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown
 Source)
       at 
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown 
Source)
       at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
       at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
       at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
       at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
       at org.apache.commons.digester.Digester.parse(Digester.java:1699)
       at 
org.apache.catalina.core.StandardHostDeployer.install(StandardHostDeployer.java:488)
       at org.apache.catalina.core.StandardHost.install(StandardHost.java:863)
       at 
org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:483)
       at 
org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:427)
       at org.apache.catalina.startup.HostConfig.start(HostConfig.java:983)
       at 
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:349)
       at 
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
       at 
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1091)
       at org.apache.catalina.core.StandardHost.start(StandardHost.java:789)
       at 
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1083)
       at 
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:478)
       at 
org.apache.catalina.core.StandardService.start(StandardService.java:480)
       at 
org.apache.catalina.core.StandardServer.start(StandardServer.java:2313)
       at org.apache.catalina.startup.Catalina.start(Catalina.java:556)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:287)
       at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:425)
Caused by: java.security.AccessControlException: access denied 
(java.lang.RuntimePermission createClassLoader)
       at 
java.security.AccessControlContext.checkPermission(AccessControlContext.java:264)
       at 
java.security.AccessController.checkPermission(AccessController.java:427)
       at java.lang.SecurityManager.checkPermission(SecurityManager.java:532)
       at 
java.lang.SecurityManager.checkCreateClassLoader(SecurityManager.java:594)
       at java.lang.ClassLoader.<init>(ClassLoader.java:225)
       at 
org.apache.commons.discovery.jdk.PsuedoSystemClassLoader.<init>(PsuedoSystemClassLoader.java:73)
       at 
org.apache.commons.discovery.jdk.JDK12Hooks.findSystemClassLoader(JDK12Hooks.java:215)
       at 
org.apache.commons.discovery.jdk.JDK12Hooks.<clinit>(JDK12Hooks.java:73)
       ... 61 more


Any hints?