grouper-users - RE: [grouper-users] PSPNG mostly working
Subject: Grouper Users - Open Discussion List
List archive
- From: "Hyzer, Chris" <>
- To: "Weston, Todd" <>, "" <>
- Subject: RE: [grouper-users] PSPNG mostly working
- Date: Mon, 9 Mar 2020 15:38:12 +0000
- Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=isc.upenn.edu; dmarc=pass action=none header.from=isc.upenn.edu; dkim=pass header.d=isc.upenn.edu; arc=none
- Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pF91gMPmmaRyzwcVZSbWzxCDec2DZssbBw/q3MyfMzU=; b=ZN5wRB4Vt8+ZZuVL0pikVmfXr5gzZbcplFtdF7c5sbyibb8XzvvHSmOUZJpNRbz+6J9YI3218S9ucCCb/Rp9hSjtD6GBxJnysHexkkdrpErNteCFjAFTHVoSXeMn06hNX/7wRNHGsHOwz5oWd6a1v31LorODcj5V611Nvm9JOA7r7QNw/Bshf0zKHnnDxProNCRS6EE4aE0vPP1WgMBT6W/SGDfjwk1XOLM/s+FJxMdLyAWcmELRybrn3bWCi7ejGyekr7q4KkYJaGyp4KKh3e6i91NPbJ1FiI46MMwHCcI/C8V1+PSE9JDTLR3ekrsHrdExilf/uLEgIxUTeNkNTg==
- Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=L22U9+EUIpHI/u38VKjEdSvWE4AAKZatQgeBnE68sA+RFRuD8GhRLgJ906OEUQz2XCYM1ZI9h8G4cmyC549pP67q7v5mU+oFrVc2DbPHNqg1rmcAMXCfz6MrgZvFqJy2UJPRfEbqBTQn4WQwZMlvSsltU0o9wlp+s+rCbvPnJIQkQrnkyEa4HQEJLBcl1RNofZPiJWX1iPGVtFYeT1loSefQhC0DuTAMardp+qKrYSTrwfs5MG8R4rn17g3TmiG+2xPveo0FfLba55HcHy6BjAFTiGCa5F3gyRW1bp28bSmJQsuIIcAmQtikZ5CsZ5NEz+0TEys5XElf3tv3jZUGQw==
37k is not a lot of users. That means you need more memory, but 16gb is way more than enough. Are you sure the JVM has that much memory available? And the host has that much memory?
From: On Behalf Of
Weston, Todd
Thanks for the direction - that got all but one group provisioning. The one in question has the largest population (~37K user subjects) and is coughing up this error:
2020-03-09 08:26:21,596: [FullSyncer(pspng_ad_role_students)-Thread] ERROR FullSyncProvisioner.fullSyncGroup(674) - - FullSyncer(pspng_ad_role_students): Problem doing full sync. Requeuing group
wsu.edu:bundle:AD:role.groups:students:Students.Enrolled.Undergraduate
I've looked for the shell commands that launch java instances, but found too many to feel confident in just adjusting any of them. Any clues as to which one should be targeted? Or am I barking up the wrong tree? The server originally had 8GB RAM and was crushing the ceiling. I increased the allocation to 16GB and now it is running at about 10GB consumed.
I appreciate any additional direction -
Todd Weston Washington State University
From:
<> on behalf of Black, Carey M. <>
Todd,
I would suggest you try to manually trigger a full sync and watch what happens with respect to those groups. ( Maybe an AD access restriction? Just a guess. )
NOTE: You might also want to turn up the log level too. See the section a bit farther down the page “Adjusting log level.” And you can set it in GSH before you manually start the full sync.
-- Carey Matthew
From: <>
On Behalf Of Weston, Todd
So – I have figured out the majority of provisioning workflow into AD – but have 5 groups that will not provision users into AD. My pspng attribute assignments have been made at the folder level and we have three different pspng configs to push groups into different OUs: The PSPNG attribute assignments are applied at the affiliates, employees and students folders. All but two of the groups in employees is provisioning users into the groups: These two groups show membership in the Grouper database of 2063 and 1736, respectively. But their AD counterparts are empty. A similar issue presents in our student groups: These groups show memberships in the database of 37,543, 1341 and 16,055, respectively, yet AD groups are empty. All of the remaining groups in both folders have populated their AD groups with no issues and maintain their dynamic membership on a daily basis.
I’m pretty certain the PSPNG config in the grouper-loader.properties is configured correctly as these other groups are provisioning properly and update regularly. And they are in the same folders as the ones that are not working. There are roll-up groups in the above output that we will populate with the child groups eventually, so most of the zero-membership groups in the list aren’t concerning – just the highlighted ones that should be getting memberships.
I have not gone as far as deleting the AD groups and allowing Grouper to recreate them as this is not a desirable method once we go into production. We which to retain the SIDs of these existing groups to make the transition from our current group populator to grouper as seamless as possible. We did empty all of these groups prior to turning on provisioning settings in Grouper – and it’s mostly worked…
One other note: we were running into memory issues originally (Java heap full in the logs) – went from 8GB to 16GB on the app server. The level memory consumption on the server is now close to 10GB, so I don’t believe we’re memory constrained any longer and I don’t see the Java memory errors.
Any Ideas? I can post filtered logs fi I know what to look for (The grouper_error.log is incredibly noisy).
-
|
- [grouper-users] PSPNG mostly working, Weston, Todd, 03/03/2020
- RE: [grouper-users] PSPNG mostly working, Black, Carey M., 03/03/2020
- Re: [grouper-users] PSPNG mostly working, Weston, Todd, 03/09/2020
- RE: [grouper-users] PSPNG mostly working, Hyzer, Chris, 03/09/2020
- Re: [grouper-users] PSPNG mostly working, Weston, Todd, 03/09/2020
- Re: [grouper-users] PSPNG mostly working, Jeffrey Williams, 03/09/2020
- Re: [grouper-users] PSPNG mostly working, Weston, Todd, 03/10/2020
- Re: [grouper-users] PSPNG mostly working, Jeffrey Williams, 03/10/2020
- Re: [grouper-users] PSPNG mostly working, Weston, Todd, 03/09/2020
- RE: [grouper-users] PSPNG mostly working, Hyzer, Chris, 03/09/2020
- Re: [grouper-users] PSPNG mostly working, Weston, Todd, 03/09/2020
- RE: [grouper-users] PSPNG mostly working, Black, Carey M., 03/03/2020
Archive powered by MHonArc 2.6.19.