grouper-users - [grouper-users] Grouper 2.4, PSPNG Patch #4: FullSync performance
Subject: Grouper Users - Open Discussion List
List archive
- From: "Bee-Lindgren, Bert" <>
- To: "" <>
- Subject: [grouper-users] Grouper 2.4, PSPNG Patch #4: FullSync performance
- Date: Mon, 18 Mar 2019 10:59:23 +0000
Grouper 2.4, PSPNG Patch #4 has been released, and it greatly improves FullSync performance by safely reusing cached information between groups. Also, incremental/changelog provisioning performance has also been significantly
improved when groups are deleted.
Here are some details:
- Before this patch, PSPNG FullSyncs always started fresh (no caching) to make sure all the data was up to date. This meant that a Full-Sync-All-Groups operation would repeatedly fetch Subject information over and over
- This patch tracks the timestamp of FullSync requests and cached information, enabling cached information to be reused whenever it is newer than the FullSync request.
- Because extra checks are now in place for stale caching, the default cache times have been increased from 10 minutes to 12 hours. This can be adjusted with the dataCacheTime_secs configuration property
- Multiple LDAP connections can be used to fetch Subject information more quickly with, of course, more load on the LDAP server. The number of LDAP-fetching workers can be adjusted with numberOfDataFetchingWorkers, which defaults to 1.
- To encourage properly sized caches, warnings are issued when caches get too full. These warnings can be disabled with areCacheSizeWarningsEnabled (defaults to true) and cacheFullnessWarningThreshold_percentage (defaults to 95).
- When subjects are usually expected to be in the PSPNG-Provisioned system, it can be helpful to warn when they are not found for some reason.
missingSubjectsWarningThreshold_percentage can be set to a percentage below which information about missing subjects will be logged. this defaults to 100% so such information is never logged.
- [grouper-users] Grouper 2.4, PSPNG Patch #4: FullSync performance, Bee-Lindgren, Bert, 03/18/2019
Archive powered by MHonArc 2.6.19.