Grouper Users - Open Discussion List

[Michael R Gettes <>]

Hi Shilen,

It appears this patch is successful.  Thank you again for the quick 
turnaround.  It is now much easier to see the real errors.

/mrg

> On Oct 28, 2016, at 1:27 PM, Michael R Gettes 
> <>
>  wrote:
> 
> +1 - thank you Shilen.  We will try and get this installed in our pre-prod 
> environment in the next few days and then it will take a few days to know 
> if the problem is really gone.  Will keep you posted.
> 
> Have a fantastic weekend!
> 
> /mrg
> 
>> On Oct 28, 2016, at 12:03 PM, Hyzer, Chris 
>> <>
>>  wrote:
>> 
>> Thanks a lot Shilen!
>> 
>> -----Original Message-----
>> From: 
>> 
>>  
>> [mailto:]
>>  On Behalf Of Shilen Patel
>> Sent: Friday, October 28, 2016 11:59 AM
>> To: Michael R. Gettes 
>> <>
>> Cc: 
>> 
>>  Mailing List 
>> <>
>> Subject: Re: [grouper-users] CHANGE_LOG_changeLogTempToChangeLog errors
>> 
>> Hi Michael,
>> 
>> Can you try the latest patch and see if that solves the problem?
>> 
>> https://bugs.internet2.edu/jira/browse/GRP-1395
>> 
>> 
>> Thanks!
>> 
>> - Shilen
>> 
>> On 10/17/16, 10:51 AM, "Shilen Patel" 
>> <>
>>  wrote:
>> 
>>> I think this happens because Grouper will cache the next sequence number
>>> to use for the change log and if the job switches servers, then the next
>>> sequence number cached would have probably already been used by the other
>>> server (thus the constraint violation).  I'll open a jira.
>>> 
>>> Thanks!
>>> 
>>> - Shilen
>>> 
>>> On 10/16/16, 4:15 PM, "Michael R. Gettes" 
>>> <>
>>>  wrote:
>>> 
>>>> Recently, we turned on running the loader on 2 hosts instead of just one.
>>>> Prior to running multiple loaders we did NOT see this problem.
>>>> This detail may have nothing to do with anything - just an observation.
>>>> 
>>>> About 200 times per day we are now seeing the following error - any
>>>> advice is appreciated.
>>>> The errors are on the CHANGE_LOG_changeLogTempToChangeLog job.
>>>> 
>>>> edu.internet2.middleware.grouper.internal.dao.GrouperDAOException:
>>>> Problem in HibernateSession: HibernateSession (5dcad092): notNew,
>>>> notReadonly, READ_WRITE_NEW, activeTransaction, session (26148b8e),
>>>> Exception in save:
>>>> edu.internet2.middleware.grouper.changeLog.ChangeLogEntry,
>>>> ByObjectStatic, query: ', cacheable: null, cacheRegion: null, entityName:
>>>> ChangeLogEntryEntity, tx type: null,
>>>> Exception in save: edu.internet2.middleware.grouper.pit.PITMembership,
>>>> edu.internet2.middleware.grouper.hibernate.ByObject@ed62b2a,
>>>> Problem in HibernateSession: HibernateSession (7929e2c0): notNew,
>>>> notReadonly, READ_WRITE_NEW, activeTransaction, session (26148b8e),
>>>> Exception in saveOrUpdate:
>>>> edu.internet2.middleware.grouper.pit.PITMembership, ByObjectStatic,
>>>> query: ', cacheable: null, cacheRegion: null, entityName: null, tx type:
>>>> null,
>>>> Problem in HibernateSession: HibernateSession (9846e71): new,
>>>> notReadonly, READ_WRITE_NEW, notActiveTransaction, session (26148b8e)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hib
>>>> e
>>>> rnateSessionCatch(HibernateSession.java:588)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHiber
>>>> n
>>>> ateSession(HibernateSession.java:710)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.ByObjectStatic.saveBatch(ByObj
>>>> e
>>>> ctStatic.java:535)
>>>>    at 
>>>> edu.internet2.middleware.grouper.internal.dao.hib3.Hib3ChangeLogEntryDAO.
>>>> s
>>>> aveBatch(Hib3ChangeLogEntryDAO.java:61)
>>>>    at 
>>>> edu.internet2.middleware.grouper.pit.PITMembership.onPreUpdate(PITMembers
>>>> h
>>>> ip.java:665)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.ByObject.saveOrUpdate(ByObject
>>>> .
>>>> java:377)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.ByObjectStatic$5.callback(ByOb
>>>> j
>>>> ectStatic.java:376)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHiber
>>>> n
>>>> ateSession(HibernateSession.java:700)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.ByObjectStatic.saveOrUpdate(By
>>>> O
>>>> bjectStatic.java:363)
>>>>    at 
>>>> edu.internet2.middleware.grouper.internal.dao.hib3.Hib3PITMembershipDAO.s
>>>> a
>>>> veOrUpdate(Hib3PITMembershipDAO.java:41)
>>>>    at 
>>>> edu.internet2.middleware.grouper.pit.PITMembership.update(PITMembership.j
>>>> a
>>>> va:298)
>>>>    at 
>>>> edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.processM
>>>> e
>>>> mbershipDelete(ChangeLogTempToEntity.java:892)
>>>>    at 
>>>> edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.access$1
>>>> 8
>>>> 00(ChangeLogTempToEntity.java:63)
>>>>    at 
>>>> edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity$1.callba
>>>> c
>>>> k(ChangeLogTempToEntity.java:144)
>>>>    at 
>>>> edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHiber
>>>> n
>>>> ateSession(HibernateSession.java:700)
>>>>    at 
>>>> edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.convertR
>>>> e
>>>> cords(ChangeLogTempToEntity.java:98)
>>>>    at 
>>>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$4.runJob(Gr
>>>> o
>>>> uperLoaderType.java:590)
>>>>    at 
>>>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(Group
>>>> e
>>>> rLoaderJob.java:416)
>>>>    at 
>>>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(Grou
>>>> p
>>>> erLoaderJob.java:318)
>>>>    at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
>>>>    at 
>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:
>>>> 5
>>>> 73)
>>>> Caused by: org.hibernate.exception.ConstraintViolationException: could
>>>> not execute batch,
>>>> Exception in save:
>>>> edu.internet2.middleware.grouper.changeLog.ChangeLogEntry,
>>>> edu.internet2.middleware.grouper.hibernate.ByObject@200750d
>>>>    at 
>>>> org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLSt
>>>> a
>>>> teConversionDelegate.java:112)
>>>>    at 
>>>> org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(St
>>>> a
>>>> ndardSQLExceptionConverter.java:42)
>>>>    at 
>>>> org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelp
>>>> e
>>>> r.java:109)
>>>>    at 
>>>> org.hibernate.engine.jdbc.batch.internal.BatchingBatch.performExecution(B
>>>> a
>>>> tchingBatch.java:119)
>>>>    at 
>>>> org.hibernate.engine.jdbc.batch.internal.BatchingBatch.doExecuteBatch(Bat
>>>> c
>>>> hingBatch.java:97)
>>>>    at 
>>>> org.hibernate.engine.jdbc.batch.internal.AbstractBatchImpl.execute(Abstra
>>>> c
>>>> tBatchImpl.java:147)
>>>>    at org.hibernate.engine.jd
>>>> 
>>>> 
>>> 
>