Grouper Users - Open Discussion List

["Zhang, Xiaoling" <>]

Hi Chris,

It occurs when the grouperLoader has been running for a while. And usually it occurs when these two loaders are running (we have dozens daily loaders).

We are working on upgrading but it’s at dev stage. We will see if we can restart it daily and what we can do about profiling JVM.

Thanks,

Xiaoling

From: <Hyzer>, Chris <>
Date: Thursday, March 17, 2016 at 2:44 PM
To: Xiaoling Zhang <>, "" <>
Subject: RE: Java heap space

Doesn’t seem right.  That’s plenty of memory for that many members.  Does it run out of memory on the first run or after it has been running for a while?  If it has to run for a while you might consider restarting it daily (at a time when nothing is running).  Otherwise, any chance you can upgrade to the latest?  Or any chance you can profile it and see what is taking up all the memory?

 

Thanks

Chris

 

From: [] On Behalf Of Zhang, Xiaoling
Sent: Thursday, March 17, 2016 3:41 PM
To:
Subject: [grouper-users] Java heap space

 

Hi,

 

We are getting the “Java heap space" error in our grouper daemon log once in a while:

 

2016-03-08 22:58:30,857: [DefaultQuartzScheduler_Worker-6] ERROR ErrorLogger.schedulerError(2185) -  - Job (DEFAULT.SQL_GROUP_LIST__etc:configuration:loader:LOADERNAME__2a8152c269534661a4a670b1811aef11 threw an exception.

org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.OutOfMemoryError: Java heap space]

        at org.quartz.core.JobRunShell.run(JobRunShell.java:213)

        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:525)

Caused by: java.lang.OutOfMemoryError: Java heap space

        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType.syncOneGroupMembership(GrouperLoaderType.java:2089)

        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType.syncGroupList(GrouperLoaderType.java:1365)

        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$3.runJob(GrouperLoaderType.java:490)

        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:413)

        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:315)

        at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

        ... 1 more

 

2016-03-16 23:07:36,389: [DefaultQuartzScheduler_Worker-6] ERROR GrouperLoaderJob.execute(318) -  - Error running up job

edu.internet2.middleware.grouper.internal.dao.GrouperDAOException: Problem in HibernateSession: HibernateSession: isNew: true, isReadonly: true, grouperTransactionType: READONLY_NEW,

Exception in uniqueResult: (class edu.internet2.middleware.grouper.Member), ByHqlStatic, query: 'from Member as m where      m.subjectIdDb       = :sid    and  m.subjectSourceIdDb = :source and  m.subjectTypeId   = :type', cacheable: true, cacheRegion: edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MemberDAO.FindBySubject, tx type: null, tx type: nullBind var[0]: 'Param (class java.lang.String): 'sid'->'GrouperSystem', Bind var[1]: 'Param (class java.lang.String): 'type'->'application'Bind var[2]: 'Param (class java.lang.String): 'source'->'g:isa',

        at edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hibernateSessionCatch(HibernateSession.java:508)

        at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:581)

        at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.uniqueResult(ByHqlStatic.java:323)

        at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MemberDAO.findBySubject(Hib3MemberDAO.java:296)

        at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MemberDAO.findBySubject(Hib3MemberDAO.java:202)

        at edu.internet2.middleware.grouper.MemberFinder.internal_findOrCreateBySubject(MemberFinder.java:346)

        at edu.internet2.middleware.grouper.MemberFinder.internal_findBySubject(MemberFinder.java:312)

        at edu.internet2.middleware.grouper.GrouperSession.start(GrouperSession.java:429)

        at edu.internet2.middleware.grouper.GrouperSession.startRootSession(GrouperSession.java:379)

        at edu.internet2.middleware.grouper.GrouperSession.startRootSession(GrouperSession.java:397)

        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:83)

        at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:525)

Caused by: java.lang.OutOfMemoryError: Java heap space

 

The error usually occurred when two loaders were running. These two loaders updat two groups that have about 400k members and 550k members, respectively. The error seemed to be fixed by itself soon (within a minute), and the two loaders finished without any other errors.

 

We are running grouper 2.1.5. JVM has 4G of memory. Should we add more memory?

 

Thanks,

Xiaoling Zhang