Grouper Users - Open Discussion List

[Gagné Sébastien <>]

Damn typos : is very slow for bulk provisioning (I know it shouldn’t be used like that).

 

As for day to day changes the PSP changelog seems good enough

 

 

De : [mailto:] De la part de Gagné Sébastien
Envoyé : 17 octobre 2012 09:11
À : Chris Hyzer; Rahul Doshi;
Objet : RE: [grouper-users] RE: PSP performance

 

I’ll second Rahul’s experience, real-time PSP is very slow for bulk provisioning (I know it should be used like that).

 

I don’t see an easy way to get around that problem, what I’m doing for the initial load/creation is this :

1-      Stop PSP deamon

2-      Do your provisioning job in grouper

3-      Run PSP bulksync when it’s done

4-      Then either :

a.       Manually run the changelog temp to changelog Job via GSH

b.      Restart the deamon for a couple of minutes then shut it back down (to get the changelog job done)

5-      In the table GROUPER_CHANGELOG_CONSUMER, manually modify the value in LAST_SEQUENCE_PROCESSED for changelog consumer PSP to the highest changelog entry number from the table GROUPER_CHANGE_LOG_ENTRY

6-      Restart the daemon with psp and all

a.       PSP will skip over all the changelog entries

 

This method is useful when you do an initial manual import, but I’m not sure how to automate it for daily loads in Grouper. You could stop the PSP (or use a fancy CRON that is Off for the night while the loader is running) and run a BulkSync, but the Real-time PSP will still have to try every changelog anyway when it’ll be back up.

 

I’m still trying to figure out how many entries is too much for real-time PSP and if this limit will be hit on daily loads…

 

 

 

De : [] De la part de Chris Hyzer
Envoyé : 16 octobre 2012 20:46
À : Rahul Doshi;
Objet : [grouper-users] RE: PSP performance

 

The real time is not for provisioning hundreds of thousands of memberships quickly, its for the day to day changes of the registry, one at a time, which is a fraction of the  total memberships, so this is reasonable performance, right?  J

 

Thanks,

Chris

 

From: [] On Behalf Of Rahul Doshi
Sent: Tuesday, October 16, 2012 4:59 PM
To:
Subject: [grouper-users] PSP performance

 

Hello,

 

I provisioned roughly 2000 groups with 500000 membership using  real-time changelog provisioning and it took about 6.5 hours.  I then deleted all the groups from LDAP target and re-provisioned them using bulksync and it took just less then an hour.  I am surprised by the difference in provisioning times using loader daemon versus bulksync.  I am wondering if there is something I might have misconfigured in the real-time provisioning or it is expected behavior.  I am running PSP 2.1.2

 

Thanks,

Rahul