Skip to Content.
Sympa Menu

grouper-users - [grouper-users] grouper performance improvements

Subject: Grouper Users - Open Discussion List

List archive

[grouper-users] grouper performance improvements


Chronological Thread 
  • From: "Hyzer, Chris" <>
  • To: " Mailing List" <>
  • Subject: [grouper-users] grouper performance improvements
  • Date: Sun, 1 Apr 2018 23:32:09 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Ironport-phdr: 9a23:KCPNWBE0jfWm2oE0Ne3Tip1GYnF86YWxBRYc798ds5kLTJ7yrs2wAkXT6L1XgUPTWs2DsrQY07GQ6/iocFdDyK7JiGoFfp1IWk1NouQttCtkPvS4D1bmJuXhdS0wEZcKflZk+3amLRodQ56mNBXdrXKo8DEdBAj0OxZrKeTpAI7SiNm82/yv95HJbAhEmDSwbaluIBmqsA7cqtQYjYx+J6gr1xDHuGFIe+NYxWNpIVKcgRPx7dqu8ZBg7ipdpesv+9ZPXqvmcas4S6dYDCk9PGAu+MLrrxjDQhCR6XYaT24bjwBHAwnB7BH9Q5fxri73vfdz1SWGIcH7S60/VDK/5KlpVRDokj8KOT4n/m/Klsx+gqFVoBO9qBNw2IPbep2ZOOZkc6/BYd8WW2xMVdtRWSxbBYO8apMCA+QDM+dYrojyuUEOoQOjDgSyBOPv0D5IhmT40aYn1OkhFB3J3AwgHtMPrnvUts74NKYJUe+p1qXI0C3DYO1Q2Tf78oTHbA0uoeyVUL92bMHfx04vFwbfgVWRr4zoJzKV1uIRs2eF9epgU/ygi3I5pw1rvDeg29osh4/UjYwW0lDJ7Tt1z5wpKdGlTUN3fMOoHIZVuiGUOIZ6Xt8uTmRqtSkkxbALuJu2cS0UxJg7xhPTc+GLfoaU7h75UOudPC10iGx4dL+7nRq+7Eqtx+zkWsm6zllHrTZJn9zJu30CyhPe6sqKR/5g8Ui91juC1wXe5+BaLkwplKfWLoIuz74/m5YPt0nIAzX4l1/sjKCMc0Up4uio5PrjYrXhvpKSL5N5hAbiPqgwg8CyHOI2PhYXU2ic4uuzyqfv/UrkQLVWlfI2lbTZsJbHKsgBvq65GQhV0po95BmjEzem0dMYnX8dIFJCZRKHk4zpO1bJIPD7F/uwn1OskDJzy/DHOL3uHInNI2DdnLj7Ybpx9ktRxBcuwdxC4p9UBL4MLO7vVkL0ttHXEBA0Pg2xzuviFtlxyoITVXqKAqCDMaPStVGI5vgoI+mJfIIVvSryK/gl5v/vk3A5g0QQfaiy3ZQLcny4A+xmLFufYXrqmNsOD3oFvhcmQOzwlFKCSSJTZ2q1X68k6TE7EoWmDZrbRo+zmryNxTq7HoZIaWBcEVCBCnPod4SfW/cQcyKePNVtkj0CVbi9VYAhzxeuuxHmy7Z5NObb5DAXtY+wnORysqfcjxYv7TFuStmG3nuWZ2Bygm4SQTIqhuZyrVE1716C1al+jLR8FMdPrbsdXR09KIbR1alnEN3oQSrAeMuEUlCrXo/gDD0sGIEf2dgLNgxdCsevlFSL9CqwAqRf3+iOD5wl4K/G93nqLIBg03vA0u8sg0RwEZgHDnGvmqMqr1ubPIXOiUjMz6s=
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

Based on reports from the users list, we identified some performance issues with Grouper which are fixed in the latest patch.

 

This includes the performance problem of cruft in the database that should be removed (not removed by default).

 

grouper_v2_3_0_api_patch_97

 

Note, this patch took a while to be released since unit tests needed to be verified and fixed and this was time consuming.  There are more patches that are queued up which will be released shortly.  The good news is this was a needed task for Grouper 2.4.

 

For the attribute performance enhancement (GRP-1705), there is now a lot more short term caching to eliminate redundant queries.  This is on stems, groups, members (subjects not memberships), attributes, actions, and assignments.

 

These are the Jira’s:

 

GRP-1674: add daemon to trim auditing table

GRP-1694: add daemon to trim auditing table of enties with no logged in user

GRP-1701: add daemon to trim deleted point in time data

GRP-1700: delete old PIT data in batches, and not in a transaction

GRP-1658: obliterate stem endless loop if already deleted

GRP-1702: if a part of deleting old data fails from daemon, continue to the next part

GRP-1704: when deleting a group, delete any composites that is a member of

GRP-1703: add daemon to obliterate old folders based on create date

GRP-1653: do not obliterate stems in transaction by default

GRP-1705: attribute performance for built in attributes

GRP-1712: cannot delete group which has requireInGroup type

 

For deleting old data, here is a wiki.  Let me know how it goes J  I will be running this at Penn and will post here our experience.

 

https://spaces.internet2.edu/display/Grouper/Grouper+automatically+delete+old+data

 

Thanks

Chris

 



  • [grouper-users] grouper performance improvements, Hyzer, Chris, 04/01/2018

Archive powered by MHonArc 2.6.19.

Top of Page