Skip to Content.
Sympa Menu

grouper-users - [grouper-users] Error provisioning large (>300K members) group

Subject: Grouper Users - Open Discussion List

List archive

[grouper-users] Error provisioning large (>300K members) group


Chronological Thread 
  • From: Mark Cairney <>
  • To: "" <>
  • Subject: [grouper-users] Error provisioning large (>300K members) group
  • Date: Wed, 04 Mar 2015 13:53:31 +0000

Hi all,

We've progressed our Grouper installation into production but have been hitting the following error when attempting to provision a particular group with both bulkSync and sync.

It looks like a buffer overflow somewhere. On the assumption that we're not the only people using Grouper with similarly large groups has anyone else seen this behaviour and is there any further tuning we can do to resolve it?

We do have another group (ALUM) which is slightly smaller at around 250,000 members which was provisioned successfully. Another worry is what would happen if this other group were to grow to a similar size to the APPS group.

Finally on an unrelated note we're probably getting close to being in a state to do some sort of write-up of our deployment for the Grouper wiki. What's the procedure for getting this sorted out?

Kind regards,

Mark


2015-03-04 13:00:31,326: [main] WARN AbstractLdap.operationRetry(1105) - - Error performing LDAP operation, retrying (attempt 0)
javax.naming.CommunicationException: SEQUENCE too long [Root exception is com.sun.jndi.ldap.Ber$EncodeException: SEQUENCE too long]; remaining name 'cn=APP,ou=affiliations,ou=grouper2,dc=authorise,dc=ed,dc=ac,dc=uk'
at com.sun.jndi.ldap.LdapCtx.c_createSubcontext(LdapCtx.java:845)
at com.sun.jndi.toolkit.ctx.ComponentDirContext.p_createSubcontext(ComponentDirContext.java:341)
at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.createSubcontext(PartialCompositeDirContext.java:268)
at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.createSubcontext(PartialCompositeDirContext.java:256)
at edu.vt.middleware.ldap.AbstractLdap.create(AbstractLdap.java:882)
at edu.vt.middleware.ldap.Ldap.create(Ldap.java:673)
at edu.internet2.middleware.psp.ldap.LdapSpmlTarget.execute(LdapSpmlTarget.java:257)
at edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:123)
at edu.internet2.middleware.psp.Psp.execute(Psp.java:456)
at edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:123)
at edu.internet2.middleware.psp.Psp.execute(Psp.java:1502)
at edu.internet2.middleware.psp.Psp.execute(Psp.java:1441)
at edu.internet2.middleware.psp.Psp.execute(Psp.java:879)
at edu.internet2.middleware.psp.Psp.execute(Psp.java:800)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at edu.internet2.middleware.psp.spml.provider.BaseSpmlProvider.execute(BaseSpmlProvider.java:123)
at edu.internet2.middleware.psp.PspCLI.run(PspCLI.java:138)
at edu.internet2.middleware.psp.PspCLI.main(PspCLI.java:84)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at edu.internet2.middleware.grouper.app.gsh.GrouperShell.handleSpecialCase(GrouperShell.java:204)
at edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:144)
at edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31)
Caused by: com.sun.jndi.ldap.Ber$EncodeException: SEQUENCE too long
at com.sun.jndi.ldap.BerEncoder.endSeq(BerEncoder.java:179)
at com.sun.jndi.ldap.LdapClient.encodeAttribute(LdapClient.java:987)
at com.sun.jndi.ldap.LdapClient.add(LdapClient.java:1032)
at com.sun.jndi.ldap.LdapCtx.c_createSubcontext(LdapCtx.java:808)
... 37 more
2015-03-04 13:00:32,603: [main] ERROR BaseSpmlProvider.execute(188) - - Target 'ldap' - Add AddResponse[pso=<null>,status=failure,error=customError,errorMessages={SEQUENCE too long},requestID=2015/03/04-11:34:40.199]
2015-03-04 13:00:32,603: [main] ERROR BaseSpmlProvider.execute(190) - - Target 'ldap' - Add XML:
<addResponse xmlns='urn:oasis:names:tc:SPML:2:0' status='failure' requestID='2015/03/04-11:34:40.199' error='customError'>
<errorMessage>SEQUENCE too long</errorMessage>
</addResponse>

2015-03-04 13:00:32,604: [main] ERROR BaseSpmlProvider.execute(188) - - Target 'psp' - Add AddResponse[pso=<null>,status=failure,error=customError,errorMessages={SEQUENCE too long},requestID=2015/03/04-11:34:40.199]
2015-03-04 13:00:32,604: [main] ERROR BaseSpmlProvider.execute(190) - - Target 'psp' - Add XML:
<addResponse xmlns='urn:oasis:names:tc:SPML:2:0' status='failure' requestID='2015/03/04-11:34:40.199' error='customError'>

--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.




Archive powered by MHonArc 2.6.16.

Top of Page