Grouper Users - Open Discussion List

[Chris Hyzer <>]

Great.  Thanks for testing so promptly.  I think that is a useful addition to the loader.  And it should work for all of the loader types (sql simple, list of groups, and all the ldap ones).  Chris

 

From: [mailto:] On Behalf Of Tim Darby
Sent: Friday, September 27, 2013 1:15 PM
To: Chris Hyzer
Cc:
Subject: Re: [grouper-users] Grouper loader and unresolvable subjects

 

That did it, thanks! I did revert the patch to GrouperLoaderType, BTW.

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Fri, Sep 27, 2013 at 9:51 AM, Chris Hyzer <> wrote:

Ugh, sorry about that.  I reproduced it in a unit test, and verified the fix now works.  Its in the jira.  You can revert the part of GrouperLoaderType back to this if you like:

 

                Subject theSubject = member.findOrGetSubject();

                if (GrouperLoader.isDryRun()) {

                  alreadyDeleted = !group[0].hasMember(theSubject);

                  GrouperLoader.dryRunWriteLine("Group: " + groupName + " delete " + GrouperUtil.subjectToString(theSubject));

                } else {

                  //go from subject since large lists might be removed from cache

                  alreadyDeleted = !group[0].deleteMember(theSubject, false);

                  LOG.debug("Group: " + groupName + " delete " + GrouperUtil.subjectToString(theSubject) + ", alreadyDeleted? " + alreadyDeleted);

                }

 

Implement the patch in the jira and let me know J

 

https://bugs.internet2.edu/jira/browse/GRP-941

 

Thanks,

Chris

 

 

 

From: [mailto:] On Behalf Of Tim Darby
Sent: Thursday, September 26, 2013 7:16 PM
To: Chris Hyzer
Subject: Re: [grouper-users] Grouper loader and unresolvable subjects

 

Not quite. Here's the stack I get now:

 

java.lang.RuntimeException: Problem with group: arizona.edu:community:sagroups:PHLT 

     at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType.syncOneGroupMembership(GrouperLoaderType.java:2343) 

     at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType.syncGroupList(GrouperLoaderType.java:1365) 
     at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$3.runJob(GrouperLoaderType.java:490) 
     at edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:413) 
     at edu.internet2.middleware.grouper.app.loader.GrouperLoader.runJobOnceForGroup(GrouperLoader.java:1004) 
     at edu.internet2.middleware.grouper.app.gsh.loaderRunOneJob.invoke(loaderRunOneJob.java:57) 
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
     at java.lang.reflect.Method.invoke(Method.java:616) 
     at bsh.Reflect.invokeMethod(Unknown Source) 
     at bsh.Reflect.invokeStaticMethod(Unknown Source) 
     at bsh.Reflect.invokeCompiledCommand(Unknown Source) 
     at bsh.Name.invokeLocalMethod(Unknown Source) 
     at bsh.Name.invokeMethod(Unknown Source) 
     at bsh.BSHMethodInvocation.eval(Unknown Source) 
     at bsh.BSHPrimaryExpression.eval(Unknown Source) 
     at bsh.BSHPrimaryExpression.eval(Unknown Source) 
     at bsh.Interpreter.eval(Unknown Source) 
     at bsh.Interpreter.eval(Unknown Source) 
     at bsh.Interpreter.eval(Unknown Source) 
     at edu.internet2.middleware.grouper.app.gsh.ShellHelper.eval(ShellHelper.java:63) 
     at edu.internet2.middleware.grouper.app.gsh.GrouperShell.run(GrouperShell.java:428) 
     at edu.internet2.middleware.grouper.app.gsh.GrouperShell.grouperShellHelper(GrouperShell.java:232) 
     at edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:162) 
     at edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31) 

    Caused by: java.lang.RuntimeException: java.lang.NullPointerException: Problem deleting member: , , 

    Problem in HibernateSession: HibernateSession: isNew: true, isReadonly: true, grouperTransactionType: NONE 

     at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$10.callback(GrouperLoaderType.java:2320) 

     at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO$1.callback(Hib3TransactionDAO.java:66) 
     at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:571) 
     at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO.transactionCallback(Hib3TransactionDAO.java:56) 
     at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:87) 
     at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType.syncOneGroupMembership(GrouperLoaderType.java:2220) 
     ... 25 more 

    Caused by: java.lang.NullPointerException: Problem deleting member: , 
     at edu.internet2.middleware.grouper.subj.LazySubject.toString(LazySubject.java:73) 
     at edu.internet2.middleware.grouper.util.GrouperUtil.subjectToString(GrouperUtil.java:7601) 
     at edu.internet2.middleware.grouper.Group.deleteMember(Group.java:2063) 
     at edu.internet2.middleware.grouper.Group.deleteMember(Group.java:1879) 
     at edu.internet2.middleware.grouper.Group.deleteMember(Group.java:1805) 
     at edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$10.callback(GrouperLoaderType.java:2250) 
     ... 30 more

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Thu, Sep 26, 2013 at 12:52 PM, Tim Darby <> wrote:

No problem, I'll let you know. :-)

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Thu, Sep 26, 2013 at 12:22 PM, Chris Hyzer <> wrote:

Any chance you can implement this patch and see if it helps?  J

 

https://bugs.internet2.edu/jira/browse/GRP-941

 

Thanks,

Chris

 

From: [mailto:] On Behalf Of Tim Darby
Sent: Thursday, September 26, 2013 12:47 PM
To:
Subject: [grouper-users] Grouper loader and unresolvable subjects

 

Sorry, if this was covered already, but I couldn't find it. Is there a way in 2.1.5 to tell Grouper loader to continue on if it encounters an unresolvable subject? This seems to occur when a subject has memberships, but is deleted from the subject source (ldap) before the memberships are deleted.

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799