Skip to Content.
Sympa Menu

grouper-users - [grouper-users] loader performance

Subject: Grouper Users - Open Discussion List

List archive

[grouper-users] loader performance


Chronological Thread 
  • From: Jon Gorrono <>
  • To:
  • Subject: [grouper-users] loader performance
  • Date: Wed, 10 Oct 2012 14:46:42 -0700


I am still down in the shallow end here :)

I am a little surprised at the time it is taking to load a group with the loader

I've created a simple view with subject_id and subject_source_id and defined the group in the ui and created a loader job in the group attributes to select users from the view for the group

There are about 130k users and in this case they are all being shoved into one group

The source for the subjects api lookups is a different view on the same remote machine as the view used by the loader to populate the group and is using the C3p0 jdbc connection provider

The network is not likely the bottleneck, and the machines, both 'development-quality', are not top-notch but their mid-range performance is usually adequate for sane debug cycles etc.

The loader had been 40 minutes and had not yet finished when I had it was stopped (abruptly, heh) for scheduled patching.

I am guessing that the struggle it is having is with the remote source for the subjects...

So I guess my question is... is it really practical to have a remote subject source? Given the answer is 'yes' then there would be some better alternate questions, but I am not sure what good ones might be right now.

Any comments, questions, suggestions are welcome.


--
Jon Gorrono
PGP Key: 0x5434509D - http{pgp.mit.edu:11371/pks/lookup?search=0x5434509D&op=index}
http{middleware.ucdavis.edu}




Archive powered by MHonArc 2.6.16.

Top of Page