Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] PSPNG full sync 'Did not get all the way through the batch'

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] PSPNG full sync 'Did not get all the way through the batch'


Chronological Thread 
  • From: "Bee-Lindgren, Bert" <>
  • To: Scott Koranda <>, grouper-users <>
  • Subject: Re: [grouper-users] PSPNG full sync 'Did not get all the way through the batch'
  • Date: Tue, 4 Sep 2018 16:05:19 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Ironport-phdr: 9a23:rKQ35RJLGYrexrP2otmcpTZWNBhigK39O0sv0rFitYgXKP3/rarrMEGX3/hxlliBBdydt6obzbKO+4nbGkU4qa6bt34DdJEeHzQksu4x2zIaPcieFEfgJ+TrZSFpVO5LVVti4m3peRMNQJW2aFLduGC94iAPERvjKwV1Ov71GonPhMiryuy+4ZLebxlKiTanfb9+MAi9oBnMuMURnYZsMLs6xAHTontPdeRWxGdoKkyWkh3h+Mq+/4Nt/jpJtf45+MFOTav1f6IjTbxFFzsmKHw65NfqtRbYUwSC4GYXX3gMnRpJBwjF6wz6Xov0vyDnuOdxxDWWMMvrRr0vRz+s87lkRwPpiCcfNj427mfXitBrjKlGpB6tvgFzz5LIbI2QMvd1Y6HTcs4ARWdZXshfSTFPAp+yYYUMAeoOP+dYoJXyqFYVtxSyGRWgCfnzxjNUm3P727Ax3eQ7EQHB2QwtB9wCvWnKo9rrLascV+G1zK/VwjXMdfNZxzH95JDVeR08v/6MR65wfcTMwkQoDAzKkE+QqZD/MzyOyOsCrXGX7+5hVeKplmEnpBtxrSapxso3jYnJh54VxkrL9Spj3IY6O8G3SE5hbdG6DZRQqjiXOo1rSc0sRGFovTw1yrwAuZOjcygK0pMnxwPHa/OZaYiE+AjsVP6JITtghnJlf6mwhwyv8Uim0e38Vte70FJOriZfiNnMq3YN2wTX6siARft98Vmu2SyV2w/N9+5EPEY5nrfYJZ452rM8iIAcvVjeEiLzhUn6kbKae0Aq+uWn9+jrfrDrppGCOIJ7lw3zN6Ejl86iDeslKgQCQWmW9fmg2LDm4EH0T7ZHg/grnqnXrJzWO8EWqrO3DgNJzoou7hiyAymp3dkbmHQKLFBIdRKHgoXsNFzDIv/1Aeq6jlixnjdn2e3KMqXvAprTLXXPjLLscLNm5EJAxgc+zNVS6pJJBr0fJP/+X1P+u8HEAhI2NgG73uXqBdF8244YRGmBGLWWMLnIvl+N/u8vI/eDZIsSuDvlM/Yo+/nggWMklVMEYKSnxZUaZGm/Hvt9PUqVe33sgsodEWgRuQo+Uerqh0CYXT5LfXayWL486S8nB4K6DIfDQYatjKaG3CemAp1WYmdGClePEXvya4qEXPIMZDqTIs9njDMESaCsR5E72h2yqQP3zqdrIvfJ9iAdu5Lu28R56/HWmBE86zN5ANmR3mSIQmx2g28HWic63KVlrkx8zleD37J4g/tdFdFL/PxGTB06NYLGw+NhFd/9RBvNftOISFagX9qmDisxQcw3w9IVZEZ9GsmiggrM3yWwH78aiaCEBJwu/q3CwnfxOt5xy2za26k5k1kmXsxPOHWphq5l8AjTGpbJnFuDl6qzaKQcxzDC9H2YzWeVuEFYURVwUbneXXwBfEfWrNL55l/cQL+0D7QoLBdBxdCYJqRUd9LpkAYOePC2A9/Zf375uGCqDBCEz/vYd4ntYWwb0Cz1B00NkgRV9nGDY0x2CT2mvnrTFnlzDl/1eAu4/vN5tWu2VAop1AyQdGVg0aa44BgYmabaRv8OiOEqoiAk/n9eEVv4+9PQB9WaqgwlNI9Re893qANN2HjF8QZwM9mkLqZuiUQTdSxwvl+o2BxrB45A18UmsSV5n0JJNauE3QYZJHuj1pfqN+iSczGqpkr9YrPK2lzYzNed87sO7/J9sVj4oQW1DRV/oW5/3YxT1H2RrtXRAQweXIi5c35/9gMy5tS4KjI4+5uS0HRtNaeutTqX0d8zGK0vxxvle9ZZPKyeGQnaFMwGQcenNOEhmx6kYg9XdO0=
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

Scott,


The old way of running the FullSyncStarter was a special changelog.psp configuration line, but the new way is better because you get different schedules for each of your provisioners. However, the lines start with otherJob instead of with changelog...


otherJob.pspng_attributes_full.class = edu.internet2.middleware.grouper.pspng.FullSyncStarter

otherJob.pspng_attributes_full._full.quartzCron = 0 * * * * ?"



Hoping this helps,
  Bert


From: <> on behalf of Scott Koranda <>
Sent: Tuesday, September 4, 2018 11:42 AM
To: grouper-users
Subject: [grouper-users] PSPNG full sync 'Did not get all the way through the batch'
 
Hi,

I am running the Grouper loader with patches up to and including 20.
Specifically I am running the TIER Docker image

tier/grouper:2.3.0-a109-u47-w12-p20

I have the following PSPNG configuration that works well:

changeLog.consumer.pspng_attributes.class = edu.internet2.middleware.grouper.pspng.PspChangelogConsumerShim
changeLog.consumer.pspng_attributes.type = edu.internet2.middleware.grouper.pspng.LdapAttributeProvisioner
changeLog.consumer.pspng_attributes.quartzCron = 0 * * * * ?
changeLog.consumer.pspng_attributes.retryOnError = true
changeLog.consumer.pspng_attributes.ldapPoolName = myPool
changeLog.consumer.pspng_attributes.provisionedAttributeName = isMemberOf
changeLog.consumer.pspng_attributes.provisionedAttributeValueFormat = ${group.name}
changeLog.consumer.pspng_attributes.userSearchBaseDn = ou=people,o=myBranch,dc=myorg,dc=org
changeLog.consumer.pspng_attributes.userSearchFilter = employeeNumber=${subject.id}
changeLog.consumer.pspng_attributes.userSearchAttributes = dn,cn,uid,mail,eduPersonPrincipalName,objectclass,employeeNumber,isMemberOf
changeLog.consumer.pspng_attributes.allProvisionedValuesPrefix = *
changeLog.consumer.pspng_attributes.grouperIsAuthoritative = true

When I add this configuration

changeLog.consumer.pspng_attributes_full.class = edu.internet2.middleware.grouper.pspng.FullSyncStarter
changeLog.consumer.pspng_attributes_full.quartzCron = 0 * * * * ? #Every minute for debugging

then I see in the log file (and in grouper_loader_log table)

Did not get all the way through the batch! 0 != 1
510java.lang.RuntimeException: Error in loader job: null, check logs: Did not get all the way through the batch! 0 != 1510
        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:474)
        at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:345)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)

I have in log4j.properties

log4j.logger.edu.internet2.middleware.grouper.pspng=DEBUG
log4j.logger.edu.internet2.middleware.grouper.changeLog=DEBUG

but I am not finding any further information about why the jobs are
failing.

How can I troubleshoot why the "full" jobs are failing?

Thanks,

Scott K



Archive powered by MHonArc 2.6.19.

Top of Page