Skip to Content.
Sympa Menu

grouper-users - [grouper-users] Grouper 2.4, PSPNG Patch #4: FullSync performance

Subject: Grouper Users - Open Discussion List

List archive

[grouper-users] Grouper 2.4, PSPNG Patch #4: FullSync performance

Chronological Thread 
  • From: "Bee-Lindgren, Bert" <>
  • To: "" <>
  • Subject: [grouper-users] Grouper 2.4, PSPNG Patch #4: FullSync performance
  • Date: Mon, 18 Mar 2019 10:59:23 +0000

Grouper 2.4, PSPNG Patch #4 has been released, and it greatly improves FullSync performance by safely reusing cached information between groups. Also, incremental/changelog provisioning performance has also been significantly improved when groups are deleted.

Here are some details:

- Before this patch, PSPNG FullSyncs always started fresh (no caching) to make sure all the data was up to date. This meant that a Full-Sync-All-Groups operation would repeatedly fetch Subject information over and over

- This patch tracks the timestamp of FullSync requests and cached information, enabling cached information to be reused whenever it is newer than the FullSync request. 

- Because extra checks are now in place for stale caching, the default cache times have been increased from 10 minutes to 12 hours. This can be adjusted with the dataCacheTime_secs configuration property

- Multiple LDAP connections can be used to fetch Subject information more quickly with, of course, more load on the LDAP server. The number of LDAP-fetching workers can be adjusted with numberOfDataFetchingWorkers, which defaults to 1.

- To encourage properly sized caches, warnings are issued when caches get too full. These warnings can be disabled with areCacheSizeWarningsEnabled (defaults to true) and cacheFullnessWarningThreshold_percentage (defaults to 95).

- When subjects are usually expected to be in the PSPNG-Provisioned system, it can be helpful to warn when they are not found for some reason. missingSubjectsWarningThreshold_percentage can be set to a percentage below which information about missing subjects will be logged. this defaults to 100% so such information is never logged.

  • [grouper-users] Grouper 2.4, PSPNG Patch #4: FullSync performance, Bee-Lindgren, Bert, 03/18/2019

Archive powered by MHonArc 2.6.19.

Top of Page