Grouper Users - Open Discussion List

[Sonia Zorba <>]

Hi,

I'm experiencing a strange behavior from several days.

I have a Grouper 2.3.0 installed on Tomcat 8 (web services + UI).

My sources are:
- an LDAP owned by an external machine;
- an LDAP in localhost;

I'm the only person currently using this testing machine, so in the 
night there are no requests to Grouper. When I open the UI application 
or call the webservice for the first time in the morning, the 
applications wait about 15 minutes, then all is working correctly.

I increased the logging levels, but I only see a long wait:

2016-09-01 08:56:18,701: [http-nio-8080-exec-4] DEBUG 
LdapSourceAdapter.getLdapResultsHelper(740) -  - searchType: searchSubject, 
filter: (& (uid=GrouperSystem) (objectclass=inetOrgPerson))

2016-09-01 09:11:57,658: [http-nio-8080-exec-4] DEBUG 
LdapSourceAdapter.getLdapUnique(862) -  - method: getLdapUnique, search: Search 
[params=scope: SUBTREE_SCOPE, filter: (& (uid=%TERM%) 
(objectclass=inetOrgPerson)), base: ou=[...], searchType=searchSubject], 
searchValue: GrouperSystem, attributeNames: Array size: 9: [0]: uid


This happens when Grouper call the external LDAP (the localhost one 
responds immediately).

I tried calling the services and the UI with curl all night with a cron 
job each minute and the problem didn't happen.
However, in the first access with another testing webapp that uses the 
GrouperClient API, that webapp waited for 15 minutes too! So this seems 
associated to each single client or session created.

I read that could be a problem of "connection pools leak", so I would 
try to forcedly close abandoned connections. How I can configure this in 
the Grouper settings?

Morover, in my catalina.out I read these bad memory leak warning:

31-Aug-2016 23:55:18.765 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named [Abandoned 
connection cleanup thread] but has failed to stop it. This is very likely to 
create a memory leak. Stack trace of thread:

 java.lang.Object.wait(Native Method)

 java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)

 
com.mysql.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:43)

31-Aug-2016 23:55:18.766 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web 
application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-AdminTaskTimer]
 but has failed to stop it. This is very likely to create a memory leak. Stack 
trace of thread:

 java.lang.Object.wait(Native Method)

 java.util.TimerThread.mainLoop(Timer.java:552)

 java.util.TimerThread.run(Timer.java:505)

31-Aug-2016 23:55:18.767 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web 
application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-HelperThread-#0]
 but has failed to stop it. This is very likely to create a memory leak. Stack 
trace of thread:

 java.lang.Object.wait(Native Method)

 
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683)

31-Aug-2016 23:55:18.767 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web 
application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-HelperThread-#1]
 but has failed to stop it. This is very likely to create a memory leak. Stack 
trace of thread:

 java.lang.Object.wait(Native Method)

 
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683)

31-Aug-2016 23:55:18.768 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web 
application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-HelperThread-#2]
 but has failed to stop it. This is very likely to create a memory leak. Stack 
trace of thread:

 java.lang.Object.wait(Native Method)

 
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683)

31-Aug-2016 23:55:18.768 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named 
[net.sf.ehcache.CacheManager@3e2b44dd] but has failed to stop it. This is 
very likely to create a memory leak.


I don't know if this could be related to the wait too. I added these 
JAVA_OPTS but it didn't help:

JAVA_OPTS="$JAVA_OPTS -Djava.awt.headless=true -Xms512M -Xmx1024m 
-XX:+UseConcMarkSweepGC -Dfile.encoding=UTF-8 -XX:PermSize=64m 
-XX:MaxPermSize=512m"


Your help will be really appreciate.

Thanks,
Sonia