grouper-users - Re: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named
Subject: Grouper Users - Open Discussion List
List archive
- From: Marwan Shaher <>
- To: ,
- Subject: Re: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named
- Date: Fri, 27 Jan 2017 16:14:12 -0700
- Ironport-phdr: 9a23:IlN0xROOH+0RUYwqaIgl6mtUPXoX/o7sNwtQ0KIMzox0Ivr9rarrMEGX3/hxlliBBdydsKMYzbeG+PixEUU7or+5+EgYd5JNUxJXwe43pCcHRPC/NEvgMfTxZDY7FskRHHVs/nW8LFQHUJ2mPw6arXK99yMdFQviPgRpOOv1BpTSj8Oq3Oyu5pHfeQtFiT6ybL9oLBi7rgrdutUSjIB/Nqs/1xzFr2dSde9L321oP1WTnxj95se04pFu9jlbtuwi+cBdT6j0Zrw0QrNEAjsoNWA1/9DrugLYTQST/HscU34ZnQRODgPY8Rz1RJbxsi/9tupgxCmXOND9QL4oVTi+6apgVRnlgzoFOTEk6mHaksx+gr9FrhKvpBJxzYDbb46XO/Vica3QZs8aSGlbU8pNSyBMDIOxYo0SBOQBJ+ZYqIz9qkMJoxSkHwmtCvngyjlVjXHr3a01yeQhHh/c3Ac9GN8OtW7brM/7NagIV+C51rLIzTXZYPNWxzj98pPFfw4mofGIWrJwa9DexlQoFw/fgVuep4LqMiqT2+8QvWab6O9gWviui24hswxxrSKvxsAxionRmI0V0ErI+j9hwIYtPdG4Skl7bsW+EJtNsSGaLIt2Td0mQ2Fsoio60KAGuZi9cSMXy5on3wbSZ+GZf4WL+B7vSeicLDRiiH54Zr6yhAy+/Vaux+D8UMS/zUxEoTBfktbWs3AAzxzT5daDSvt65kqh2C6P1wXc6+xEO0w7ia3bK5omwr4qjJUcrEPDEjXol0rrka+abkQk+u625OT7erjqu4GQOoxuhg3jPKkjmdazDfkmPgUNRWSX5+qx2b378U38WrpKj/k2kqfDsJDdIMQWvqm3DBVP0oct8Rm/CS2q3skYnXYdLFJKZgiHgpP1NFHJJPD4Cu2/jE6xnzds3fzJIKDuAojVInjZjLjhZap961JbyAcrwtBf/ZVUCqwZIP3tQE/9rcHYDgQnPAyu2ObqE9F91oIFWWKTGa+VLrnesV6O5uIzPeaMfokVtyjhK/Q7/fLhk2I2mUJONZWuiJQNb22gE+4jPl6Ue2HEg9EdHH0MsxZkCuHmlRnKSjNaYTC3Vrk74BkmF4u6AJ3HQYfri7XS8j28G8hzb3pZA1bEKnfhd4ieE6MJYTiNK8kniTwNVbW7Y6Qm0Ra0vQP9jZdLE7yHqWUjqZv/2Y0ttKXonhYo+GksAg==
Sean,
I'm trying to troubleshoot a somewhat similar issue in our dev environment. I think I've narrowed it down to the "singleGroupSearchFilter" parameter and how it works with the logic in the
edu/internet2/middleware/grouper/pspng/GrouperGroupInfo.java code. I have the singleGroupSearchFilter parameter in grouper-loader.properties set to
(&(objectclass=group)(cn=${group.extension}))
That deletes the groups from AD if they were deleted in the Grouper UI, as long as the groups didn't have any subjects added to them at all.
I've also tried it with
(&(objectclass=group)(cn=${grouperUtil.extensionFromName(name)}))
But, that doesn't seem to delete the groups whether they had subjects added to them at any point in time, or not.
It seems to me though from your log post that the singleGroupSearchFilter parameter is not set to an ldap filter ? If I'm reading it correctly, the parameter is set to "dn: cn=${grouperUtil.extensionFromName(name)} sAMAccountName: ${grouperUtil.extensionFromName(name)} cn: ${grouperUtil.extensionFromName(name)} objectclass: group " ?
Thanks,
- Marwan
On 01/23/2017 09:28 AM, Sean Mason wrote:
Hi There,
I have a pilot instance of Grouper running, with PSPNG provisioning
group memberships to active directory for an academic department.
I’m having an issue with the ChangeLog consumer tripping over groups
that were created, then deleted or renamed.
When the consumer gets to the transaction in the log, the result is:
2017-01-23 11:02:04,488: [DefaultQuartzScheduler_Worker-4] INFO
LdapGroupProvisioner.createGroup(251) - - Creating LDAP group for
GrouperGroup: null
(which makes sense to me, since the group no longer exists).
However, this throws a wrench in the JEXL evaluation:
2017-01-23 11:02:04,495: [DefaultQuartzScheduler_Worker-4] ERROR
Provisioner.evaluateJexlExpression(523) - - Jexl Expression dn:
cn=${grouperUtil.extensionFromName(name)}
sAMAccountName: ${grouperUtil.extensionFromName(name)}
cn: ${grouperUtil.extensionFromName(name)}
objectclass: group could not be evaluated for subject 'null/null' and
group 'null/null' which used variableMap
'{userSearchBaseDn=OU=people,DC=…, provisionerType=LdapGroupProvisioner,
groupCreationBaseDn=OU=Grouper,OU=…,
utils=edu.internet2.middleware.grouper.pspng.PspJexlUtils@193221e,
provisionerName=pspng_nexus, groupSearchBaseDn=OU=Grouper,…'
2017-01-23 11:02:04,497: [DefaultQuartzScheduler_Worker-4] ERROR
ChangeLogHelper.processRecords(255) - - Error
java.lang.NullPointerException
at java.io.StringReader.<init>(StringReader.java:50)
at
edu.internet2.middleware.grouper.pspng.LdapGroupProvisioner.createGroup(LdapGroupProvisioner.java:258)
at
edu.internet2.middleware.grouper.pspng.LdapGroupProvisioner.createGroup(LdapGroupProvisioner.java:54)
at
edu.internet2.middleware.grouper.pspng.Provisioner.provisionItem(Provisioner.java:887)
at
edu.internet2.middleware.grouper.pspng.Provisioner.provisionBatchOfItems(Provisioner.java:1299)
at
edu.internet2.middleware.grouper.pspng.PspChangelogConsumerShim.processChangeLogEntries(PspChangelogConsumerShim.java:71)
at
edu.internet2.middleware.grouper.changeLog.ChangeLogHelper.processRecords(ChangeLogHelper.java:245)
at
edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$4.runJob(GrouperLoaderType.java:629)
at
edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:416)
at
edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:318)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
Then:
2017-01-23 11:02:04,501: [DefaultQuartzScheduler_Worker-4] ERROR
ChangeLogHelper.processRecords(286) - - Did not get all the way through
the batch! -1 != 2884196
Which puts us in a state where the same transactions are tried again and
again without moving forward. I tried setting “retryOnError” to false,
but that did not appear to change anything. I suspect that setting may
only affect “catchable” errors? In any case, even if we get past this
transaction, there are a number right after representing memberships
being added to the group that could also be tried, and will likely fail…
Have I missed a configuration that will allow the PSPNG to skip over
these types of entries, or at the very least, move on from this error?
I am on the latest patches of both the API, and PSPNG, and willing to
experiment to get this going.
Thanks,
Sean.
- [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Sean Mason, 01/23/2017
- Re: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Marwan Shaher, 01/27/2017
- RE: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Sean Mason, 01/31/2017
- Re: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Bee-Lindgren, Bert, 01/31/2017
- RE: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Shaun Koh, 01/31/2017
- Re: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Bee-Lindgren, Bert, 01/31/2017
- RE: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Sean Mason, 01/31/2017
- Re: [grouper-users] PSPNG ChangeLog issue where group is delete, or re-named, Marwan Shaher, 01/27/2017
Archive powered by MHonArc 2.6.19.