Grouper Users - Open Discussion List

[Tim Darby <>]

We have 360,000 groups and almost 3,000,000 memberships and it takes approximately 10 hours to bulk sync.  One thing I noticed this morning is that I haven't made any changes to ehcache.xml.  How important is that for good performance?

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

On Wed, Mar 20, 2013 at 12:16 PM, Gagné Sébastien <> wrote:

How horrible ?

Here it takes about 15 minutes to run for 13 000 groups and a total of 400 000-something memberships

 

De : [mailto:] De la part de Tim Darby
Envoyé : 20 mars 2013 15:14
À : Michael R. Gettes
Cc : Rahul Doshi;

Objet : Re: [grouper-users] vt-ldap pooling

 

Thanks for the reference, I'm glad to see this is being worked on.  Bulk sync performance is horrible here and I'm trying to figure out why.

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Wed, Mar 20, 2013 at 11:39 AM, Michael R. Gettes <> wrote:

Have a look at  https://bugs.internet2.edu/jira/browse/GRP-882

 

yes, 3 is the current limit but the jira item is intended to work towards fixing this problem.

 

/mrg

 

On Mar 20, 2013, at 2:20 PM, Tim Darby <>

 wrote:

I noticed that I'm only getting 3 pooled connections too. So, is it true that Grouper ignores the settings in ldap.properties?

 

Does increasing the pool size really result in much of a benefit?

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Thu, Feb 28, 2013 at 10:37 AM, Rahul Doshi <> wrote:

I added/modified following lines in LdapSourceAdapter.java and I can see
now 5 ldap connections when I do netstat.

  LdapPoolConfig ldapPoolConfig = new LdapPoolConfig();

  ldapPoolConfig.setMaxPoolSize(10);
  ldapPoolConfig.setMinPoolSize(5);
  ldapPool = new SoftLimitLdapPool(ldapPoolConfig, factory);

Thanks,
Rahul



On 2/26/13 8:44 PM, "Gagné Sébastien" <>
wrote:

>It's a good question, here I do have a reference to the ldap.properties
>in my sources.xml (tried it a fully qualified name with no more success) :
>
>    <!-- Note that most of the ldap configuration is in the properties
>file.
>         The filename can be a file in your classpath or an absolute
>pathname. -->
>
>    <init-param>
>      <param-name>ldapProperties_file</param-name>
>      <param-value>ldap.properties</param-value>
>    </init-param>
>
>
>-----Message d'origine-----
>De :
>[mailto:] De la part de Tom Zeller
>Envoyé : 26 février 2013 17:14
>À : Rahul Doshi
>Cc :
>Objet : Re: [grouper-users] vt-ldap pooling
>
>Are you sure vt-ldap is reading ldap.properties ?
>
>I think you have to instruct the ldap source adapter to read
>ldap.properties in sources.xml, as ldap_propertiesFile or something like
>that.
>
>On Tue, Feb 26, 2013 at 9:29 AM, Rahul Doshi <> wrote:
>> Hello,
>>
>> I am using using LdapSourceAdapter in sources.xml and have specified
>> properties below in ldap.properties to increase minimum pool size to
>> 10 but it's not taking effect.  Even after specifying minimum pool
>> size to ten I just see three ldap connections when I do netstat.  Can
>> anyone suggest me what I might be missing.
>>
>> edu.vt.middleware.ldap.pool.minPoolSize = 10
>> edu.vt.middleware.ldap.pool.maxPoolSize = 20
>>
>> Thanks,
>> Rahul