grouper-users - [grouper-users] loader performance
Subject: Grouper Users - Open Discussion List
List archive
- From: Jon Gorrono <>
- To:
- Subject: [grouper-users] loader performance
- Date: Wed, 10 Oct 2012 14:46:42 -0700
I am a little surprised at the time it is taking to load a group with the loader
I've created a simple view with subject_id and subject_source_id and defined the group in the ui and created a loader job in the group attributes to select users from the view for the group
There are about 130k users and in this case they are all being shoved into one group
The source for the subjects api lookups is a different view on the same remote machine as the view used by the loader to populate the group and is using the C3p0 jdbc connection provider
The network is not likely the bottleneck, and the machines, both 'development-quality', are not top-notch but their mid-range performance is usually adequate for sane debug cycles etc.
The loader had been 40 minutes and had not yet finished when I had it was stopped (abruptly, heh) for scheduled patching.
I am guessing that the struggle it is having is with the remote source for the subjects...
So I guess my question is... is it really practical to have a remote subject source? Given the answer is 'yes' then there would be some better alternate questions, but I am not sure what good ones might be right now.
Any comments, questions, suggestions are welcome.
Jon Gorrono
PGP Key: 0x5434509D - http{pgp.mit.edu:11371/pks/lookup?search=0x5434509D&op=index}
http{middleware.ucdavis.edu}
- [grouper-users] loader performance, Jon Gorrono, 10/10/2012
- RE: [grouper-users] loader performance, Chris Hyzer, 10/10/2012
- Re: [grouper-users] loader performance, Jon Gorrono, 10/11/2012
- RE: [grouper-users] loader performance, Chris Hyzer, 10/11/2012
- RE: [grouper-users] loader performance, Chris Hyzer, 10/12/2012
- RE: [grouper-users] loader performance, Gagné Sébastien, 10/12/2012
- Re: [grouper-users] loader performance, Jon Gorrono, 10/16/2012
- RE: [grouper-users] loader performance, Gagné Sébastien, 10/16/2012
- RE: [grouper-users] loader performance, Chris Hyzer, 10/16/2012
- Re: [grouper-users] loader performance, Jon Gorrono, 10/16/2012
- Re: [grouper-users] loader performance, Jon Gorrono, 10/16/2012
- Re: [grouper-users] loader performance, Jon Gorrono, 10/16/2012
- RE: [grouper-users] loader performance, Gagné Sébastien, 10/12/2012
- Re: [grouper-users] loader performance, Jon Gorrono, 10/11/2012
- RE: [grouper-users] loader performance, Chris Hyzer, 10/10/2012
Archive powered by MHonArc 2.6.16.