Grouper Users - Open Discussion List

[Tim Darby <>]

I'm running 2.1.3 and I have that DataConnector.  The only difference is that I changed the MINUS filter to my own custom OR filter because I wanted to specify a specific list of stems to be provisioned.

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

On Wed, Mar 20, 2013 at 12:26 PM, Gagné Sébastien <> wrote:

Also, which versions are you running ? I think Tom made some big improvements by not referencing members in group data; in psp-resolver.xml you should have a DataConnector similar to :

 

  <!-- The GroupWithoutMembershipsDataConnector returns attributes representing the group whose name is the principal name.

    The returned group must be a child of the stem whose name is the edu.internet2.middleware.psp.baseStem property. Groups under

    the "etc" stem are omitted. No memberships (groups or members) should be returned by this data connector to improve performance

    of identifier resolution. -->

  <resolver:DataConnector

    id="GroupWithoutMembershipsDataConnector"

    xsi:type="grouper:GroupDataConnector">

    <!-- The MINUS filter matches stems which match the first child filter and not the second. -->

    <grouper:Filter xsi:type="grouper:MINUS">

      <!-- The GroupInStem filter matches groups which are children of the given stem. -->

      <grouper:Filter

        xsi:type="grouper:GroupInStem"

        name="${edu.internet2.middleware.psp.baseStem}"

        scope="SUB" />

      <grouper:Filter

        xsi:type="grouper:GroupInStem"

        name="etc"

        scope="SUB" />

    </grouper:Filter>

 

    <grouper:Attribute id="etc:mail:groupeDistribution" />

    <grouper:Attribute id="etc:mail:afficherGAL" />

  </resolver:DataConnector>

 

 

De : [mailto:] De la part de Rahul Doshi
Envoyé : 20 mars 2013 15:22
À :

Objet : Re: [grouper-users] vt-ldap pooling

 

Bulksync is lot slower for us here at CMU as well.  It takes about hour and half to sync close to 200 groups with 500000 membership.  Part of the reason could be that we are also maintaining isMemberOf attribute using PSP.

 

Thanks,

Rahul

 

From: Gagné Sébastien <>
Date: Wednesday, March 20, 2013 3:16 PM
To: Tim Darby <>, "Michael R. Gettes" <>
Cc: Rahul Doshi <>, "" <>
Subject: RE: [grouper-users] vt-ldap pooling

 

How horrible ?

Here it takes about 15 minutes to run for 13 000 groups and a total of 400 000-something memberships

 

De : [] De la part de Tim Darby
Envoyé : 20 mars 2013 15:14
À : Michael R. Gettes
Cc : Rahul Doshi;
Objet : Re: [grouper-users] vt-ldap pooling

 

Thanks for the reference, I'm glad to see this is being worked on.  Bulk sync performance is horrible here and I'm trying to figure out why.

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Wed, Mar 20, 2013 at 11:39 AM, Michael R. Gettes <> wrote:

Have a look at  https://bugs.internet2.edu/jira/browse/GRP-882

 

yes, 3 is the current limit but the jira item is intended to work towards fixing this problem.

 

/mrg

 

On Mar 20, 2013, at 2:20 PM, Tim Darby <>

 wrote:

I noticed that I'm only getting 3 pooled connections too. So, is it true that Grouper ignores the settings in ldap.properties?

 

Does increasing the pool size really result in much of a benefit?

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Thu, Feb 28, 2013 at 10:37 AM, Rahul Doshi <> wrote:

I added/modified following lines in LdapSourceAdapter.java and I can see
now 5 ldap connections when I do netstat.

  LdapPoolConfig ldapPoolConfig = new LdapPoolConfig();

  ldapPoolConfig.setMaxPoolSize(10);
  ldapPoolConfig.setMinPoolSize(5);
  ldapPool = new SoftLimitLdapPool(ldapPoolConfig, factory);

Thanks,
Rahul



On 2/26/13 8:44 PM, "Gagné Sébastien" <>
wrote:

>It's a good question, here I do have a reference to the ldap.properties
>in my sources.xml (tried it a fully qualified name with no more success) :
>
>    <!-- Note that most of the ldap configuration is in the properties
>file.
>         The filename can be a file in your classpath or an absolute
>pathname. -->
>
>    <init-param>
>      <param-name>ldapProperties_file</param-name>
>      <param-value>ldap.properties</param-value>
>    </init-param>
>
>
>-----Message d'origine-----
>De :
>[mailto:] De la part de Tom Zeller
>Envoyé : 26 février 2013 17:14
>À : Rahul Doshi
>Cc :
>Objet : Re: [grouper-users] vt-ldap pooling
>
>Are you sure vt-ldap is reading ldap.properties ?
>
>I think you have to instruct the ldap source adapter to read
>ldap.properties in sources.xml, as ldap_propertiesFile or something like
>that.
>
>On Tue, Feb 26, 2013 at 9:29 AM, Rahul Doshi <> wrote:
>> Hello,
>>
>> I am using using LdapSourceAdapter in sources.xml and have specified
>> properties below in ldap.properties to increase minimum pool size to
>> 10 but it's not taking effect.  Even after specifying minimum pool
>> size to ten I just see three ldap connections when I do netstat.  Can
>> anyone suggest me what I might be missing.
>>
>> edu.vt.middleware.ldap.pool.minPoolSize = 10
>> edu.vt.middleware.ldap.pool.maxPoolSize = 20
>>
>> Thanks,
>> Rahul