Grouper Users - Open Discussion List

["Klug, Lawrence" <>]

Here is the output from the command.  It looks like it was successful.

 

Thanks,

 

Lawrence

 

gsh 0% new edu.internet2.middleware.grouper.misc.SyncPITTables().syncAllPITTables()

 

 

Searching for missing active point in time fields

Found 0 missing active point in time fields

 

 

Searching for missing active point in time members

Found 29926 missing active point in time members

Done making 29926 updates

 

 

Searching for missing active point in time stems

Found 8 missing active point in time stems

Done making 8 updates

 

 

Searching for missing active point in time groups

Found 6 missing active point in time groups

Done making 6 updates

 

 

Searching for missing active point in time role sets

Found 0 missing active point in time role sets

 

 

Searching for missing active point in time attribute defs

Found 1 missing active point in time attribute defs

Done making 1 updates

 

 

Searching for missing active point in time attribute def names

Found 1 missing active point in time attribute def names

Done making 1 updates

 

 

Searching for missing active point in time attribute def name sets

Found 1 missing active point in time attribute def name sets

Done making 1 updates

 

 

Searching for missing active point in time actions

Found 1 missing active point in time actions

Done making 1 updates

 

 

Searching for missing active point in time action sets

Found 1 missing active point in time action sets

Done making 1 updates

 

 

Searching for missing active point in time group sets

Found 64 missing active point in time group sets

Done making 64 updates

 

 

Searching for missing active point in time memberships

Found 32162 missing active point in time memberships

Done making 32162 updates

 

 

Searching for missing active point in time attribute assigns

Found 3 missing active point in time attribute assigns

Done making 3 updates

 

 

Searching for missing active point in time attribute assign values

Found 7 missing active point in time attribute assign values

Done making 7 updates

 

 

Searching for point in time attribute assign values that should be inactive

Found 0 active point in time attribute assign values that should be inactive

 

 

Searching for point in time attribute assigns that should be inactive

Found 0 active point in time attribute assigns that should be inactive

 

 

Searching for point in time memberships that should be inactive

Found 0 active point in time memberships that should be inactive

 

 

Searching for point in time group sets that should be inactive

Found 0 active point in time group sets that should be inactive

 

 

Searching for point in time action sets that should be inactive

Found 0 active point in time action sets that should be inactive

 

 

Searching for point in time actions that should be inactive

Found 0 active point in time actions that should be inactive

 

 

Searching for point in time attribute def name sets that should be inactive

Found 0 active point in time attribute def name sets that should be inactive

 

 

Searching for point in time attribute def names that should be inactive

Found 0 active point in time attribute def names that should be inactive

 

 

Searching for point in time attribute defs that should be inactive

Found 0 active point in time attribute defs that should be inactive

 

 

Searching for point in time role sets that should be inactive

Found 0 active point in time role sets that should be inactive

 

 

Searching for point in time groups that should be inactive

Found 0 active point in time groups that should be inactive

 

 

Searching for point in time stems that should be inactive

Found 0 active point in time stems that should be inactive

 

 

Searching for point in time members that should be inactive

Found 0 active point in time members that should be inactive

 

 

Searching for point in time fields that should be inactive

Found 0 active point in time fields that should be inactive

java.lang.Long: 62181

gsh 1%

 

From: Shilen Patel [mailto:]
Sent: Tuesday, October 02, 2012 6:12 AM
To: Klug, Lawrence
Cc: Chris Hyzer;
Subject: Re: [grouper-users] RE: Change Log Consumer

 

Hi,

 

It looks like your point in time tables are out of sync.  Can you try running the following using GSH?

 

new edu.internet2.middleware.grouper.misc.SyncPITTables().syncAllPITTables()

 

Then see if you're still having the same errors.  If so or if the sync fails, you may need to clear out the grouper_change_log_entry_temp table first.

 

Thanks!

 

-- Shilen

 

From: "Klug, Lawrence" <>
Date: Mon, 1 Oct 2012 21:16:55 +0000
To: Chris Hyzer <>, "" <>
Subject: [grouper-users] RE: Change Log Consumer

 

The records are going in to grouper_change_log_entry_temp, but then nothing.  I’m seeing this error in the logs:

 

2012-10-01 14:11:50,056: [DefaultQuartzScheduler_Worker-9] ERROR GrouperLoaderJob.runJob(406) -  - Error on job: CHANGE_LOG_changeLogTempToChangeLog

java.lang.RuntimeException: Active PITGroup with sourceId=fc52a7a7314442a1833e00b315a6984d not found,

Problem in HibernateSession: HibernateSession: isNew: true, isReadonly: false, grouperTransactionType: READ_WRITE_NEW

                at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3PITGroupDAO.findBySourceIdActive(Hib3PITGroupDAO.java:100)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.processMembershipAdd(ChangeLogTempToEntity.java:706)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.access$1700(ChangeLogTempToEntity.java:59)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity$1.callback(ChangeLogTempToEntity.java:135)

                at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:571)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.convertRecords(ChangeLogTempToEntity.java:91)

                at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$4.runJob(GrouperLoaderType.java:550)

                at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:398)

                at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:300)

                at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

                at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:525)

2012-10-01 14:11:50,061: [DefaultQuartzScheduler_Worker-9] ERROR GrouperLoaderJob.execute(303) -  - Error running up job

java.lang.RuntimeException: Active PITGroup with sourceId=fc52a7a7314442a1833e00b315a6984d not found,

Problem in HibernateSession: HibernateSession: isNew: true, isReadonly: false, grouperTransactionType: READ_WRITE_NEW

                at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3PITGroupDAO.findBySourceIdActive(Hib3PITGroupDAO.java:100)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.processMembershipAdd(ChangeLogTempToEntity.java:706)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.access$1700(ChangeLogTempToEntity.java:59)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity$1.callback(ChangeLogTempToEntity.java:135)

                at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:571)

                at edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.convertRecords(ChangeLogTempToEntity.java:91)

                at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$4.runJob(GrouperLoaderType.java:550)

                at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:398)

                at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:300)

                at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

                at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:525)

 

From: Chris Hyzer []
Sent: Sunday, September 30, 2012 7:36 PM
To: Klug, Lawrence;
Subject: RE: Change Log Consumer

 

As events occur,  they are put into grouper_change_log_entry_temp table.

At the top of the minute, they are moved from there to the grouper_change_log_entry table.  If this is not occurring then the change log daemon in the loader is not running successfully.  At some point after that (e.g. a few seconds after the top of the minute), your change log consumer should run.  You should see a row for your consumer in the grouper_change_log_consumer table.  There will be a last index processed there which should be updated to the last grouper_change_log_entry index.  If that is not happening, then your consumer is not running.  If it is running, and not doing anything, then maybe it is not matching the records correctly… if you want to make a simple example change log consumer (something that I could load in my env), I could try to help troubleshoot, or let me know how you want to proceed.

 

Thanks,

Chris

 

From: Klug, Lawrence
Sent: Friday, September 28, 2012 12:36 PM
To: Chris Hyzer;
Subject: Change Log Consumer

 

So far I’m not seeing Admin UI events picked up by my ChangeLogConsumer class – do I need to configure something for this to happen?

 

Thanks,

 

Lawrence