Grouper Users - Open Discussion List

[Tom Zeller <>]

I thought there was a way to "chunk" an attribute with a large number
of values into multiple requests, but maybe that never got done.
Something similar is done with Active Directory because of its limits,
I think, maybe that can be made more general, not sure.

On Fri, Mar 6, 2015 at 12:09 PM, David Langenberg 
<>
 wrote:
> Hi Mark,
>
> What is the context of this operation?  Is it creating the group, adding a
> membership, or something else?  What is it trying to add?  I've never seen
> this before, but this error is being thrown by JNDI itself, so whatever
> you're doing it's got a very large piece of data in it.
>
> Dave
>
> On Wed, Mar 4, 2015 at 6:53 AM, Mark Cairney 
> <>
>  wrote:
>> It looks like a buffer overflow somewhere. On the assumption that we're
>> not the only people using Grouper with similarly large groups has anyone
>> else seen this behaviour and is there any further tuning we can do to
>> resolve it?
>>
>> We do have another group (ALUM) which is slightly smaller at around
>> 250,000 members which was provisioned successfully. Another worry is what
>> would happen if this other group were to grow to a similar size to the APPS
>> group.
>>
>> Finally on an unrelated note we're probably getting close to being in a
>> state to do some sort of write-up of our deployment for the Grouper wiki.
>> What's the procedure for getting this sorted out?
>>
>> Kind regards,
>>
>> Mark
>>
>>
>> 2015-03-04 13:00:31,326: [main] WARN AbstractLdap.operationRetry(1105) -
>> - Error performing LDAP operation, retrying (attempt 0)
>> javax.naming.CommunicationException: SEQUENCE too long [Root exception is
>> com.sun.jndi.ldap.Ber$EncodeException: SEQUENCE too long]; remaining name
>> 'cn=APP,ou=affiliations,ou=grouper2,dc=authorise,dc=ed,dc=ac,dc=uk'
>>         at com.sun.jndi.ldap.LdapCtx.c_createSubcontext(LdapCtx.java:845)
>>         at
>> com.sun.jndi.toolkit.ctx.ComponentDirContext.p_createSubcontext(ComponentDirContext.java:341)
>>         at
>> com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.createSubcontext(PartialCompositeDirContext.java:268)
>>         at
>> com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.createSubcontext(PartialCompositeDirContext.java:256)
>>         at
>> edu.vt.middleware.ldap.AbstractLdap.create(AbstractLdap.java:882)
>>         at edu.vt.middleware.ldap.Ldap.create(Ldap.java:673)
>>         at
>> edu.internet2.middleware.psp.ldap.LdapSpmlTarget.execute(LdapSpmlTarget.java:257)
>>         at
>> edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:177)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:483)
>>         at
>> edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:123)
>>         at edu.internet2.middleware.psp.Psp.execute(Psp.java:456)
>>         at
>> edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:177)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:483)
>>         at
>> edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:123)
>>         at edu.internet2.middleware.psp.Psp.execute(Psp.java:1502)
>>         at edu.internet2.middleware.psp.Psp.execute(Psp.java:1441)
>>         at edu.internet2.middleware.psp.Psp.execute(Psp.java:879)
>>         at edu.internet2.middleware.psp.Psp.execute(Psp.java:800)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:483)
>>         at
>> edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:123)
>>         at edu.internet2.middleware.psp.PspCLI.run(PspCLI.java:138)
>>         at edu.internet2.middleware.psp.PspCLI.main(PspCLI.java:84)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:483)
>>         at
>> edu.internet2.middleware.grouper.app.gsh.GrouperShell.handleSpecialCase(GrouperShell.java:204)
>>         at
>> edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:144)
>>         at
>> edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31)
>> Caused by: com.sun.jndi.ldap.Ber$EncodeException: SEQUENCE too long
>>         at com.sun.jndi.ldap.BerEncoder.endSeq(BerEncoder.java:179)
>>         at
>> com.sun.jndi.ldap.LdapClient.encodeAttribute(LdapClient.java:987)
>>         at com.sun.jndi.ldap.LdapClient.add(LdapClient.java:1032)
>>         at com.sun.jndi.ldap.LdapCtx.c_createSubcontext(LdapCtx.java:808)
>>         ... 37 more
>> 2015-03-04 13:00:32,603: [main] ERROR BaseSpmlProvider.execute(188) -  -
>> Target 'ldap' - Add
>> AddResponse[pso=<null>,status=failure,error=customError,errorMessages={SEQUENCE
>> too long},requestID=2015/03/04-11:34:40.199]
>> 2015-03-04 13:00:32,603: [main] ERROR BaseSpmlProvider.execute(190) -  -
>> Target 'ldap' - Add XML:
>> <addResponse xmlns='urn:oasis:names:tc:SPML:2:0' status='failure'
>> requestID='2015/03/04-11:34:40.199' error='customError'>
>>   <errorMessage>SEQUENCE too long</errorMessage>
>> </addResponse>
>>
>> 2015-03-04 13:00:32,604: [main] ERROR BaseSpmlProvider.execute(188) -  -
>> Target 'psp' - Add
>> AddResponse[pso=<null>,status=failure,error=customError,errorMessages={SEQUENCE
>> too long},requestID=2015/03/04-11:34:40.199]
>> 2015-03-04 13:00:32,604: [main] ERROR BaseSpmlProvider.execute(190) -  -
>> Target 'psp' - Add XML:
>> <addResponse xmlns='urn:oasis:names:tc:SPML:2:0' status='failure'
>> requestID='2015/03/04-11:34:40.199' error='customError'>
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>
>
>
> --
> David Langenberg
> Identity & Access Management
> The University of Chicago