Grouper Users - Open Discussion List

["Hyzer, Chris" <>]

I think those errors are not accurate...

Have you reloaded the webapp, or do you restart tomcat when applying changes? 
 Is this app the only one in that tomcat or do other apps run there too?  
Which patches do you have installed exactly?  See  
grouperPatchStatus.properties

Did this only start happening recently?

Thanks
Chris

-----Original Message-----
From: 

 
[mailto:]
 On Behalf Of Sonia Zorba
Sent: Thursday, September 01, 2016 4:15 AM
To: 

Subject: [grouper-users] Grouper applications stuck after time of inactivity

Hi,

I'm experiencing a strange behavior from several days.

I have a Grouper 2.3.0 installed on Tomcat 8 (web services + UI).

My sources are:
- an LDAP owned by an external machine;
- an LDAP in localhost;

I'm the only person currently using this testing machine, so in the 
night there are no requests to Grouper. When I open the UI application 
or call the webservice for the first time in the morning, the 
applications wait about 15 minutes, then all is working correctly.

I increased the logging levels, but I only see a long wait:

2016-09-01 08:56:18,701: [http-nio-8080-exec-4] DEBUG 
LdapSourceAdapter.getLdapResultsHelper(740) -  - searchType: searchSubject, 
filter: (& (uid=GrouperSystem) (objectclass=inetOrgPerson))

2016-09-01 09:11:57,658: [http-nio-8080-exec-4] DEBUG 
LdapSourceAdapter.getLdapUnique(862) -  - method: getLdapUnique, search: 
Search [params=scope: SUBTREE_SCOPE, filter: (& (uid=%TERM%) 
(objectclass=inetOrgPerson)), base: ou=[...], searchType=searchSubject], 
searchValue: GrouperSystem, attributeNames: Array size: 9: [0]: uid


This happens when Grouper call the external LDAP (the localhost one 
responds immediately).

I tried calling the services and the UI with curl all night with a cron 
job each minute and the problem didn't happen.
However, in the first access with another testing webapp that uses the 
GrouperClient API, that webapp waited for 15 minutes too! So this seems 
associated to each single client or session created.

I read that could be a problem of "connection pools leak", so I would 
try to forcedly close abandoned connections. How I can configure this in 
the Grouper settings?

Morover, in my catalina.out I read these bad memory leak warning:

31-Aug-2016 23:55:18.765 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named [Abandoned 
connection cleanup thread] but has failed to stop it. This is very likely to 
create a memory leak. Stack trace of thread:

  java.lang.Object.wait(Native Method)

  java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)

  
com.mysql.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:43)

31-Aug-2016 23:55:18.766 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-AdminTaskTimer]
 but has failed to stop it. This is very likely to create a memory leak. 
Stack trace of thread:

  java.lang.Object.wait(Native Method)

  java.util.TimerThread.mainLoop(Timer.java:552)

  java.util.TimerThread.run(Timer.java:505)

31-Aug-2016 23:55:18.767 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-HelperThread-#0]
 but has failed to stop it. This is very likely to create a memory leak. 
Stack trace of thread:

  java.lang.Object.wait(Native Method)

  
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683)

31-Aug-2016 23:55:18.767 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-HelperThread-#1]
 but has failed to stop it. This is very likely to create a memory leak. 
Stack trace of thread:

  java.lang.Object.wait(Native Method)

  
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683)

31-Aug-2016 23:55:18.768 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named 
[C3P0PooledConnectionPoolManager[identityToken->12yj2ui9i1qqmmey649b1u|3b702e77]-HelperThread-#2]
 but has failed to stop it. This is very likely to create a memory leak. 
Stack trace of thread:

  java.lang.Object.wait(Native Method)

  
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683)

31-Aug-2016 23:55:18.768 WARNING [localhost-startStop-4] 
org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The 
web application [grouper] appears to have started a thread named 
[net.sf.ehcache.CacheManager@3e2b44dd] but has failed to stop it. This is 
very likely to create a memory leak.


I don't know if this could be related to the wait too. I added these 
JAVA_OPTS but it didn't help:

JAVA_OPTS="$JAVA_OPTS -Djava.awt.headless=true -Xms512M -Xmx1024m 
-XX:+UseConcMarkSweepGC -Dfile.encoding=UTF-8 -XX:PermSize=64m 
-XX:MaxPermSize=512m"


Your help will be really appreciate.

Thanks,
Sonia