Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] Adventures in PSPNG

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] Adventures in PSPNG


Chronological Thread 
  • From: "Peter St. Onge" <>
  • To: "Bee-Lindgren, Bert" <>
  • Cc: "" <>
  • Subject: Re: [grouper-users] Adventures in PSPNG
  • Date: Wed, 18 Jan 2017 11:17:57 -0500
  • Ironport-phdr: 9a23:XBKjfRFhaoAnyAIxz+zqP51GYnF86YWxBRYc798ds5kLTJ7ypsywAkXT6L1XgUPTWs2DsrQf2raQ6PGrCTJIyK3CmUhKSIZLWR4BhJdetC0bK+nBN3fGKuX3ZTcxBsVIWQwt1Xi6NU9IBJS2PAWK8TW94jEIBxrwKxd+KPjrFY7OlcS30P2594HObwlSijewZbx/IA+4oAjVucUbgopvIbstxxXUpXdFZ/5Yzn5yK1KJmBb86Maw/Jp9/ClVpvks6c1OX7jkcqohVbBXAygoPG4z5M3wqBnMVhCP6WcGUmUXiRVHHQ7I5wznU5jrsyv6su192DSGPcDzULs5Vyiu47ttRRT1kyoMKSI3/3/LhcxxlKJboQyupxpjw47PfYqZMONycr7Bcd8GQGZMWNtaWS5cDYOmd4YBEvQPPehYoYf+qVUBoxSxCguwC+3g0TJImn370Lcm3+g9HwzL3AotFM8OvnTOq9X1Mb8fXe6vwqbW0TXMcelW0irg5ojUaBwqvOiCXbR/ccXPx0UkCgTIjk2Opoz5ITyZzP8Ns3Sc7+pmWuKglXUqqxxtojio3McsjY/Jhp4Sylze6Sp22p84KNulQ0B1Zt6kFYFftyCcN4ZuXsMiQ3totzggxbIbo5K7ZjUKyJIhyhXCaPKHa5CF7g/9WOuSOzt0mW5pdK6lixqv/0Ws1PfwWtS33VpXtiZJj8fAu3MX2xDO9sSLVuFx8lq91TuBzQze5eNJLEYpnqTBMZEh2KQ/lp8LvETDACD2nEL2gbeNeUU54Oin9f7oYqjlq5OBLYN0jBr+Pr4zmsyjBuQ4KA8OX26H+eS7zrHs4Vf2TK1Ljv0wjKbZrIjXKdkFqqO6GQNZz5ov5wqlAzu73tkUg2MLIE9GdR6al4TpPkvBIPH8DfexmVSslzJryujePrL/HpXCMGLPkKz9fbZ67U5cxxQ8wMtC55JIDbEBOvXzWknttNzfFBM2Lxa7z/79CNphzoMeRX6PAqiBPaPdq1+I4f8vI/GSa48PoTr9NuMl6OD0jX8iglIdeaip3YALaHCjAPhqOUSZYXzwgtgfC2cKuBQxTPD0hFGYTzFcemuyDOoA4WRxIo+rSKPCQIyimrGHmG+RE4dKLCgSAF2WDTHieojBX/YKZC2IL8lJlT0YE7eoV4Iq1VejuBKsmJR9Ke+BsBUVqZ/5nONpoaX0kx4/v3QgF8mB3ieWU2ZykW4gWiMxxqd5vUs7wV7VgvswuOBRCdEGv6ABaQw9L5OJirUiU90=

Hi Bert,

As of this morning, I should be up to date on patches - in
grouper.apiBinary-2.3.0/grouperPatchStatus.properties I have:

grouper_v2_3_0_pspng_patch_7.date = 2017/01/18 08:50:30
grouper_v2_3_0_pspng_patch_7.state = applied
grouper_v2_3_0_api_patch_44.date = 2017/01/18 08:30:08
grouper_v2_3_0_api_patch_44.state = applied

(I similarly updated the UI to current)

I stopped the UI before making these changes, and the grouper loader
wasn't working at the time.

Still seeing this in the logs when I start the Grouper loader tho ....

2017-01-18 10:54:23,357: [pspng_idp-easi-FullSync] DEBUG
HibernateSession.callbackHibernateSession(716) - -
grouperTransactionType: READONLY_OR_USE_EXISTING, auditControl:
WILL_NOT_AUDIT, hibernateSession: HibernateSession (24c95b1f): new,
readonly, READONLY_NEW, notActiveTransaction, session (1f7d6317),
hibernateSessionsInThreadLocal: 24c95b1f, willCreateAudit: false,
createdContext: false, closedSession: true
2017-01-18 10:54:23,358: [pspng_idp-easi-FullSync] DEBUG
GrouperUtil.substituteExpressionLanguage(9332) - - Subsituting EL:
'${utils.containedWithin(provisionerName,
stemAttributes['etc:pspng:provision_to'],
groupAttributes['etc:pspng:provision_to']) &&
!utils.containedWithin(provisionerName,
stemAttributes['etc:pspng:do_not_provision_to'],
groupAttributes['etc:pspng:do_not_provision_to'])}', and with env vars:
idIndex, userSearchBaseDn, groupAttributes, groupCreationBaseDn,
stemAttributes, utils, groupSearchBaseDn, name, provisionerName, group,
provisionerType, grouperUtil with result: 'true'
2017-01-18 10:54:23,358: [pspng_idp-easi-FullSync] DEBUG
Provisioner.evaluateJexlExpression(518) - - Evaluated Jexl expression:
true FROM ${utils.containedWithin(provisionerName,
stemAttributes['etc:pspng:provision_to'],
groupAttributes['etc:pspng:provision_to']) &&
!utils.containedWithin(provisionerName,
stemAttributes['etc:pspng:do_not_provision_to'],
groupAttributes['etc:pspng:do_not_provision_to'])} WITH variables
{idIndex=10051, userSearchBaseDn=dc=maple,dc=utoronto,dc=ca,
groupAttributes={},
groupCreationBaseDn=ou=groupertest,dc=maple,dc=utoronto,dc=ca,
stemAttributes={etc:pspng:provision_to=[pspng_idp-easi]},
utils=edu.internet2.middleware.grouper.pspng.PspJexlUtils@555a820a,
groupSearchBaseDn=ou=groupertest,dc=maple,dc=utoronto,dc=ca,
name=utormaple:test1:pete-test, provisionerName=pspng_idp-easi,
group=Group[name=utormaple:test1:pete-test,uuid=0a1c1f738bea49078ba50ecf717f223b],
provisionerType=LdapGroupProvisioner}
2017-01-18 10:54:23,358: [pspng_idp-easi-FullSync] DEBUG
Provisioner.shouldGroupBeProvisioned(1230) - - pspng_idp-easi: Group
utormaple:test1:pete-test matches group-selection filter.
2017-01-18 10:54:23,358: [pspng_idp-easi-FullSync] INFO
LdapGroupProvisioner.createGroup(251) - - Creating LDAP group for
GrouperGroup: utormaple:test1:pete-test
2017-01-18 10:54:23,358: [pspng_idp-easi-FullSync] ERROR
FullSyncProvisioner.processGroup(327) - - pspng_idp-easi: Problem doing
full sync. Requeuing utormaple:test1:pete-test
java.lang.NullPointerException
at
edu.internet2.middleware.grouper.pspng.LdapGroupProvisioner.createGroup(LdapGroupProvisioner.java:253)
at
edu.internet2.middleware.grouper.pspng.LdapGroupProvisioner.createGroup(LdapGroupProvisioner.java:54)
at
edu.internet2.middleware.grouper.pspng.Provisioner.prepareGroupCache(Provisioner.java:715)
at
edu.internet2.middleware.grouper.pspng.Provisioner.startProvisioningBatch(Provisioner.java:468)
at
edu.internet2.middleware.grouper.pspng.FullSyncProvisioner.processGroup(FullSyncProvisioner.java:311)
at
edu.internet2.middleware.grouper.pspng.FullSyncProvisioner.thread_manageFullSyncProcessing(FullSyncProvisioner.java:174)
at
edu.internet2.middleware.grouper.pspng.FullSyncProvisioner$1.run(FullSyncProvisioner.java:132)
at java.lang.Thread.run(Thread.java:745)

I'm happy to experiment as you see fit.

Thanks and best, -- pete

On 2017-01-17 01:31 AM, Bee-Lindgren, Bert wrote:
> Peter,
>
>
> I've compared your logs to the current version of PSPNG, and they don't
> line up. This is probably because there are patches that haven't yet
> been applied. If this is the case, then there's a good chance the
> problem has been addressed.
>
>
> Please check on the patch status of the api/daemon installation
> (grouperPatchStatus.properties).
>
>
> Sincerely,
>
> Bert Bee-Lindgren
>
>
>
> ------------------------------------------------------------------------
> *From:*
>
> <>
> on behalf of Bee-Lindgren, Bert
> <>
> *Sent:* Monday, January 16, 2017 6:29 PM
> *To:* Peter St. Onge
> *Cc:*
>
> *Subject:* Re: [grouper-users] Adventures in PSPNG
>
> I'll look at the cause in a minute, but it will help to confirm that
> 'current 2.3 Grouper' includes all the patches?
>
> Thanks
>
>> On Jan 16, 2017, at 2:24 PM, Peter St. Onge
>> <>
>> wrote:
>>
>> I'm working on spinning up a current 2.3 Grouper machine for our dev
>> group but am running into some issues writing into our OpenLDAP backend.
>>
>> This error message keeps popping up ...
>>
>>
>> 2017-01-16 13:55:50,424: [pspng_idp-easi-FullSync] DEBUG
>> GrouperUtil.substituteExpressionLanguage(9332) - - Subsituting EL:
>> '${utils.containedWithin(provisionerName,
>> stemAttributes['etc:pspng:provision_to'],
>> groupAttributes['etc:pspng:provision_to']) &&
>> !utils.containedWithin(provisionerName,
>> stemAttributes['etc:pspng:do_not_provision_to'],
>> groupAttributes['etc:pspng:do_not_provision_to'])}', and with env vars:
>> idIndex, userSearchBaseDn, groupAttributes, groupCreationBaseDn,
>> stemAttributes, utils, groupSearchBaseDn, name, provisionerName, group,
>> provisionerType, grouperUtil with result: 'true'
>> 2017-01-16 13:55:50,424: [pspng_idp-easi-FullSync] DEBUG
>> Provisioner.evaluateJexlExpression(510) - - Evaluated Jexl expression:
>> true FROM ${utils.containedWithin(provisionerName,
>> stemAttributes['etc:pspng:provision_to'],
>> groupAttributes['etc:pspng:provision_to']) &&
>> !utils.containedWithin(provisionerName,
>> stemAttributes['etc:pspng:do_not_provision_to'],
>> groupAttributes['etc:pspng:do_not_provision_to'])} WITH variables
>> {idIndex=10051, userSearchBaseDn=dc=maple,dc=utoronto,dc=ca,
>> groupAttributes={},
>> groupCreationBaseDn=ou=groupertest,dc=maple,dc=utoronto,dc=ca,
>> stemAttributes={etc:pspng:provision_to=[pspng_idp-easi]},
>> utils=edu.internet2.middleware.grouper.pspng.PspJexlUtils@56935138,
>> groupSearchBaseDn=ou=groupertest,dc=maple,dc=utoronto,dc=ca,
>> name=utormaple:test1:pete-test, provisionerName=pspng_idp-easi,
>> group=Group[name=utormaple:test1:pete-test,uuid=0a1c1f738bea49078ba50ecf717f223b],
>> provisionerType=LdapGroupProvisioner}
>> 2017-01-16 13:55:50,424: [pspng_idp-easi-FullSync] DEBUG
>> Provisioner.shouldGroupBeProvisioned(1208) - - pspng_idp-easi: Group
>> utormaple:test1:pete-test matches group-selection filter.
>> 2017-01-16 13:55:50,424: [pspng_idp-easi-FullSync] INFO
>> LdapGroupProvisioner.createGroup(231) - - Creating LDAP group for
>> GrouperGroup: utormaple:test1:pete-test
>> 2017-01-16 13:55:50,424: [pspng_idp-easi-FullSync] ERROR
>> FullSyncProvisioner.processGroup(328) - - pspng_idp-easi: Problem doing
>> full sync. Requeuing utormaple:test1:pete-test
>> java.lang.NullPointerException
>> at
>> edu.internet2.middleware.grouper.pspng.LdapGroupProvisioner.createGroup(LdapGroupProvisioner.java:233)
>> at
>> edu.internet2.middleware.grouper.pspng.LdapGroupProvisioner.createGroup(LdapGroupProvisioner.java:54)
>> at
>> edu.internet2.middleware.grouper.pspng.Provisioner.prepareGroupCache(Provisioner.java:705)
>> at
>> edu.internet2.middleware.grouper.pspng.Provisioner.startProvisioningBatch(Provisioner.java:461)
>> at
>> edu.internet2.middleware.grouper.pspng.FullSyncProvisioner.processGroup(FullSyncProvisioner.java:312)
>> at
>> edu.internet2.middleware.grouper.pspng.FullSyncProvisioner.thread_manageFullSyncProcessing(FullSyncProvisioner.java:175)
>> at
>> edu.internet2.middleware.grouper.pspng.FullSyncProvisioner$1.run(FullSyncProvisioner.java:133)
>> at java.lang.Thread.run(Thread.java:745)
>>
>>
>> I've tried
>> * provisioning empty groups,
>> * provisioning new groups with a default (known-good) user that would
>> get replaced at first update
>>
>> Any pointers most welcome!
>>
>>
>> In passing, I'm getting a metric truckload of these ...
>>
>> 2017-01-16 13:55:51,425: [pspng_idp-easi-FullSync] DEBUG
>> GrouperClientLog.debug(82) - - Cant find text for variable: 'newline'
>>
>> I did a recursive search for any file containing "[^\$]newline" but
>> didn't find this defined anywhere. I wonder if this is a java-specific
>> thing, and whether there any way I can fix this.
>>
>>
>>
>> Thanks and best, -- pete
>>
>> --
>> Peter St. Onge
>>
>> Information Security Architect (416)978-5030
>> Business Continuity and Communications
>> Information + Technology Services University of Toronto


--
Peter St. Onge

Information Security Architect (416)978-5030
Business Continuity and Communications
Information + Technology Services University of Toronto



Archive powered by MHonArc 2.6.19.

Top of Page