Subject: Grouper Users - Open Discussion List
- From: Gagné Sébastien <>
- To: "Rahul Doshi" <>, <>
- Subject: RE: [grouper-users] PSP performance
- Date: Mon, 29 Apr 2013 13:12:28 -0400
- Authentication-results: sfpop-ironport01.merit.edu; dkim=neutral (message not signed) header.i=none
Quick ideas :
How would ordering be maintained ? e.g. you don’t want to rename a group before its description is modified.
What if you have conflicting information ? e.g. two consecutive description modification of the same group, which one to keep (comes back to ordering transaction)
How would you know you have “all” the changes for that object ?
As for your problem, could you have two changelog consumer row ? You could have one for “last published to Active MQ” and one for “current aggregation id”, that way you restart the changelog on “last published” and start aggregating there.
While jira https://bugs.internet2.edu/jira/browse/GRP-882 to improve the PSP real-time provisioning is worked on we are looking to implement a stop gap solution to improve PSP real-time provisioning performance. This is how we are planning to do that. We will implement a custom change log consumer that will combine multiple updates to same object and publish it to a queue like ActiveMQ. We will implement a client that will grab the message from the queue and perform the update as single ldap operation.
One limitation we already know of this approach is we would have to continuously advance change log consumer pointer even though we are still aggregating changes in a single message to push it to ActiveMQ. If change log consumer dies for whatever reason before we could publish the message to the queue we will lose changes and only way to recover from that would be to do bulkSync. Are there any other issues that we could potentially face? Also if anyone has alternative approach to improve PSP real-time performance we would very much like to hear.
- [grouper-users] PSP performance, Rahul Doshi, 04/29/2013
- [grouper-users] RE: PSP performance, Chris Hyzer, 04/29/2013
- <Possible follow-up(s)>
- RE: [grouper-users] PSP performance, Gagné Sébastien, 04/29/2013
- Re: [grouper-users] PSP performance, Michael R. Gettes, 04/29/2013
Archive powered by MHonArc 2.6.16.