Grouper Users - Open Discussion List

[Chris Hyzer <>]

Oh, put this to debug and see if it helps:

log4j.logger.edu.internet2.middleware.grouper.app.loader.db.GrouperLoaderResultset
 = DEBUG


btw, debug logging can get verbose and is assumed to be on for debugging 
problems, if this is something people need during steady state operation, 
maybe we could bump it up to INFO level or something...

Thanks,
Chris

-----Original Message-----
From: Jeff McCullough 
[mailto:]
 
Sent: Wednesday, April 11, 2012 4:11 PM
To: Chris Hyzer
Cc: 
;
 CalNet Administration
Subject: Re: [grouper-users] grouper loader as service

I admit the code should give the same result for either, but it isn't what I 
see.

This is the log listing for an LDAP_SIMPLE configuration:

2012-04-11 13:02:45,524: [DefaultQuartzScheduler_Worker-3] DEBUG 
LdapSession.callbackLdapSession(177) -  - pre-checkout: ldap id: ucbLdap, 
pool active: 0, available: 1
2012-04-11 13:02:45,524: [DefaultQuartzScheduler_Worker-3] DEBUG 
LdapSession.callbackLdapSession(183) -  - post-checkout: ldap id: ucbLdap, 
pool active: 1, available: 0
2012-04-11 13:02:45,639: [DefaultQuartzScheduler_Worker-3] DEBUG 
LdapSession$1.callback(274) -  - Found 88 results for serverId: ucbLdap, 
searchDn: null, filter: 
'(&(objectclass=person)(!(berkeleyedutestidflag=true))(!(berkeleyeduempexdate=*))(departmentnumber=JKASD))',
 returning attribute: uid, some results: ArrayList size: 88: [0]: 223

For an LDAP_GROUPS_FROM_ATTRIBUTES configuration I only see the first two 
debug lines.  The third line below is a deleted user being replaced.

2012-04-11 13:04:30,469: [DefaultQuartzScheduler_Worker-9] DEBUG 
LdapSession.callbackLdapSession(177) -  - pre-checkout: ldap id: ucbLdap, 
pool active: 0, available: 1
2012-04-11 13:04:30,469: [DefaultQuartzScheduler_Worker-9] DEBUG 
LdapSession.callbackLdapSession(183) -  - post-checkout: ldap id: ucbLdap, 
pool active: 1, available: 0
2012-04-11 13:04:40,209: [DefaultQuartzScheduler_Worker-9] INFO  
EventLog.info(141) -  - 
[40cef69645f24f45b3392329698916a5,'GrouperSystem','application'] add member: 
group='test:AffiliateStatus:groups:EMPLOYEE-TYPE-STAFF' list='members' 
subject='545702'/'person'/'LDAP' (200ms)

Jeff

On Apr 11, 2012, at 12:45 PM, Chris Hyzer wrote:

> Hmm, is it this log message from LdapSession?
> 
>          if (LOG.isDebugEnabled()) {
>            LOG.debug("Found " + result.size() + " results for serverId: " + 
> ldapServerId + ", searchDn: " + searchDn
>              + ", filter: '" + filter + "', returning attribute: " 
>              + attributeName + ", some results: " + 
> GrouperUtil.toStringForLog(result, 100) );
>          }
> 
> Can you remind me an example of the log message you would like to see?
> 
> Thanks,
> Chris
> 
> -----Original Message-----
> From: Jeff McCullough 
> [mailto:]
>  
> Sent: Wednesday, April 11, 2012 3:09 PM
> To: Chris Hyzer
> Cc: 
> ;
>  CalNet Administration
> Subject: Re: [grouper-users] grouper loader as service
> 
> Hi Chris,
> 
> Yes, that fixed the error. The two methods (at least LDAP_SIMPLE and 
> LDAP_GROUPS_FROM_ATTRIBUTES) don't seem to have the same logging under 
> debug though. SIMPLE shows its queries, but LGFA does not.
> 
> Cheers,
> Jeff
> 
> On Apr 8, 2012, at 8:42 AM, Chris Hyzer wrote:
> 
>> Whoops, there is a small bug that I just fixed.  Can you either patch your 
>> source and build the grouper.jar again or download this grouper.jar (2.1.1 
>> snapshot) to use in your loader?
>> 
>> http://www.internet2.edu/grouper/release/2.1.1/grouper.jar
>> 
>> https://bugs.internet2.edu/jira/browse/GRP-770
>> 
>> Let me know if it works.
>> 
>> Thanks,
>> Chris
>> 
>> 
>> 
>> -----Original Message-----
>> From: 
>> 
>>  
>> [mailto:]
>>  On Behalf Of Jeff McCullough
>> Sent: Friday, April 06, 2012 9:36 PM
>> To: 
>> 
>> Cc: CalNet Administration
>> Subject: [grouper-users] grouper loader as service
>> 
>> 
>> I've successfully used both the ldap loader types:
>> 
>> LDAP_GROUPS_FROM_ATTRIBUTES
>> LDAP_SIMPLE
>> 
>> I can run both the scripts below successfully from gsh. When I use gsh.sh 
>> -loader, the LDAP_SIMPLE group runs as expected. The other one fails with 
>> this error the below error. What am I missing?
>> 
>> Thanks,
>> Jeff
>> 
>> ------------------
>> grouper_error.log snippet
>> -----------------
>> 2012-04-06 18:27:00,055: [DefaultQuartzScheduler_Worker-4] ERROR 
>> GrouperLoaderJob.runJob(387) -  - Error on job: 
>> LDAP_GROUPS_FROM_ATTRIBUTES__test:Departments:myLdapGroupFromAttributes__2324252375624390a09e671fb01c5710
>> java.lang.RuntimeException: Cant find the ldap connection named: 'null' in 
>> the grouper-loader.properties.  Should have entry: ldap.null.url,
>> Problem with ldap conection: null,
>> Error querying ldap server id: null, searchDn: null, filter: 'null', 
>> returning subject attribute: null
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderConfig.retrieveLdapProfile(GrouperLoaderConfig.java:288)
>>      at 
>> edu.internet2.middleware.grouper.ldap.LdapSession.blockingLdapPool(LdapSession.java:54)
>>      at 
>> edu.internet2.middleware.grouper.ldap.LdapSession.callbackLdapSession(LdapSession.java:174)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.db.GrouperLoaderResultset.initForLdapGroupsFromAttributes(GrouperLoaderResultset.java:656)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$8.runJob(GrouperLoaderType.java:893)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:379)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:281)
>>      at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
>>      at 
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)
>> 2012-04-06 18:27:00,068: [DefaultQuartzScheduler_Worker-4] ERROR 
>> GrouperLoaderJob.execute(284) -  - Error running up job
>> java.lang.RuntimeException: Cant find the ldap connection named: 'null' in 
>> the grouper-loader.properties.  Should have entry: ldap.null.url,
>> Problem with ldap conection: null,
>> Error querying ldap server id: null, searchDn: null, filter: 'null', 
>> returning subject attribute: null
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderConfig.retrieveLdapProfile(GrouperLoaderConfig.java:288)
>>      at 
>> edu.internet2.middleware.grouper.ldap.LdapSession.blockingLdapPool(LdapSession.java:54)
>>      at 
>> edu.internet2.middleware.grouper.ldap.LdapSession.callbackLdapSession(LdapSession.java:174)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.db.GrouperLoaderResultset.initForLdapGroupsFromAttributes(GrouperLoaderResultset.java:656)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$8.runJob(GrouperLoaderType.java:893)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:379)
>>      at 
>> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:281)
>>      at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
>>      at 
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)
>> -------------------
>> 
>> ------------------
>> LDAP_GROUPS_FROM_ATTRIBUTES.gsh
>> ------------------
>> grouperSession = GrouperSession.startRootSession();
>> group = new \
>> GroupSave(grouperSession).assignName("test:Departments:myLdapGroupFromAttributes").assignCreateParentStemsIfNotExist(true).save();
>> attributeAssign = 
>> group.getAttributeDelegate().assignAttribute(LoaderLdapUtils.grouperLoaderLdapAttributeDefName()).getAttributeAssign();attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapTypeName(),
>>  "LDAP_GROUPS_FROM_ATTRIBUTES");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapFilterName(),
>>  "(&(objectclass=person) 
>> \(!(berkeleyedutestidflag=true))(!(berkeleyeduempexdate=*))(departmentnumber=JICCS))");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapQuartzCronName(),
>>  "0 0/3 * * * ?");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapServerIdName(),
>>  "ucbLdap");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapSourceIdName(),
>>  "LDAP");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapSubjectAttributeName(),
>>  "uid");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapGroupAttributeName(),
>>  "departmentnumber");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapSubjectIdTypeName(),
>>  "subjectIdentifier");
>> group = GroupFinder.findByName(grouperSession, 
>> "test:Departments:myLdapGroupFromAttributes");
>> loaderRunOneJob(group);
>> 
>> 
>> 
>> ------------------------------
>> LDAP_SIMPLE.gsh
>> ------------------------------
>> 
>> grouperSession = GrouperSession.startRootSession();
>> group = new 
>> GroupSave(grouperSession).assignName("someStem:myLdapGroup").assignCreateParentStemsIfNotExist(true).save();
>> attributeAssign = 
>> group.getAttributeDelegate().assignAttribute(LoaderLdapUtils.grouperLoaderLdapAttributeDefName()).getAttributeAssign();
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapTypeName(),
>>  "LDAP_SIMPLE");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapFilterName(),
>>  "(&(objectclass=person) \
>> (!(berkeleyedutestidflag=true))(!(berkeleyeduempexdate=*))(departmentnumber=JICCS))");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapQuartzCronName(),
>>  "45 0/3 * * * ?");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapServerIdName(),
>>  "ucbLdap");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapSourceIdName(),
>>  "LDAP");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapSubjectAttributeName(),
>>  "uid");
>> attributeAssign.getAttributeValueDelegate().assignValue(LoaderLdapUtils.grouperLoaderLdapSubjectIdTypeName(),
>>  "subjectIdentifier");
>> group = GroupFinder.findByName(grouperSession, "someStem:myLdapGroup");
>> loaderRunOneJob(group);
>> ~                         
>