Grouper Users - Open Discussion List

[Gagné Sébastien <>]

Hi,

I don’t have a definite answer for you since I haven’t tried it, but you could try using something like the “grouper:MINUS” filter (this is from grouper-to-ActiveDirectory examples) :

 

  <resolver:DataConnector

    id="GroupDataConnector"

    xsi:type="grouper:GroupDataConnector">

    <!-- The MINUS filter matches stems which match the first child filter and not the second. -->

    <grouper:Filter xsi:type="grouper:MINUS">

      <!-- The GroupInStem filter matches groups which are children of the given stem. -->

      <grouper:Filter

        xsi:type="grouper:GroupInStem"

        name="${edu.internet2.middleware.psp.baseStem}"

        scope="SUB" />

      <grouper:Filter

        xsi:type="grouper:GroupInStem"

        name="etc"

        scope="SUB" />

    </grouper:Filter>

    <!-- The "members" attribute values are equivalent to group.getMembers(). -->

    <grouper:Attribute id="members:immediate" />

    <!-- The "groups" attribute values are equivalent to group.getGroups(). -->

    <grouper:Attribute id="groups:immediate" />

  </resolver:DataConnector>

 

If the groups that causes the problem are all in the same stem you could add a MINUS filter. There might be a filter type “grouper:GroupNameExact” that could exclude one single group, but as I said I haven’t tried it (grouper:StemInStem does exist).

 

Good luck

 

 

De : [mailto:] De la part de Gasperowicz Jérémy
Envoyé : 5 novembre 2012 04:57
À :
Objet : Re: [grouper-users] Error on job: CHANGE_LOG_changeLogTempToChangeLog

 

Ok,

So the problem seems to be an encoding problem between datas in LDAP and in Grouper, as this is a test folder, it isn't important.
But as I've done bin/gsh.sh -psp -sync edu:group to sync a group, How can I sync some groups, not all, with the loader, so i will exclude the group that is a problem, is it possible ?

Thanks,
Jérémy

Le 05/11/2012 09:46, Gasperowicz Jérémy a écrit :

Hi,

I've deleted the row that was a problem an the error disappeared and now I can see errors went unnoticed :

2012-11-05 09:23:06,638: [DefaultQuartzScheduler_Worker-2] ERROR BaseSpmlProvider.execute(452) -  - Target 'artois:ldap' - Search SearchResponse[psos=0,status=failure,error=noSuchIdentifier,errorMessages={[LDAP: error code 32 - No Such Object]},requestID=2012/11/05-09:23:06.620]
2012-11-05 09:23:06,639: [DefaultQuartzScheduler_Worker-2] ERROR BaseSpmlProvider.execute(454) -  - Target 'artois:ldap' - Search XML:
<spmlsearch:searchResponse xmlns='urn:oasis:names:tc:SPML:2:0' xmlns:spmlsearch='urn:oasis:names:tc:SPML:2:0:search' status='failure' requestID='2012/11/05-09:23:06.620' error='noSuchIdentifier'>
  <errorMessage>[LDAP: error code 32 - No Such Object]</errorMessage>
</spmlsearch:searchResponse>

2012-11-05 09:23:06,640: [DefaultQuartzScheduler_Worker-2] ERROR BaseSpmlProvider.execute(452) -  - Target 'psp' - Search SearchResponse[psos=0,status=failure,error=noSuchIdentifier,errorMessages={[LDAP: error code 32 - No Such Object]},requestID=2012/11/05-09:23:06.620]
2012-11-05 09:23:06,640: [DefaultQuartzScheduler_Worker-2] ERROR BaseSpmlProvider.execute(454) -  - Target 'psp' - Search XML:
<spmlsearch:searchResponse xmlns='urn:oasis:names:tc:SPML:2:0' xmlns:spmlsearch='urn:oasis:names:tc:SPML:2:0:search' status='failure' requestID='2012/11/05-09:23:06.620' error='noSuchIdentifier'>
  <errorMessage>[LDAP: error code 32 - No Such Object]</errorMessage>
</spmlsearch:searchResponse>

2012-11-05 09:23:06,641: [DefaultQuartzScheduler_Worker-2] ERROR Psp.hasAttribute(2027) -  - SearchResponse[psos=0,status=failure,error=noSuchIdentifier,errorMessages={[LDAP: error code 32 - No Such Object]},requestID=2012/11/05-09:23:06.620]

Thanks,
Jérémy

Le 31/10/2012 17:05, Shilen Patel a écrit :

OK I'm going to look through the output in more detail to see if I can

figure out what caused the problem.  But in the meantime, I think you can

resolve the issue by deleting one row.

delete from grouper_pit_memberships where

id='9df80189aed7424e91a1163406d62bbe';

commit;

You may have to restart the Grouper daemon to clear caches.

Let me know if that works or not.

Thanks!

-- Shilen

On 10/31/12 11:38 AM, "Gasperowicz Jérémy"

 wrote:

Hi,

I'm using a MySQL database which supports transactions (innoDB engine),

no XML import/export, no database recovery

What do you mean by membership enable/disable ?

select source_id, count(*) from grouper_pit_memberships where active='T'

group by source_id having count(*)>  1; :

source_id         

count(*)

fb686e35f40547948dbc3a860885bde2',     '2'

And for the two last queries, they are in attachment (too many datas for

the second query in "grouper_audit_entry_v.txt", which fields do you need

?)

Thanks !

Jérémy

Le 31/10/2012 15:33, Shilen Patel a écrit :

Hi,

OK let's try to figure out what went wrong here.  First off all, what

database are you running and does it support transactions?  Have you

used

the XML import/export or have you done any other partial database

recovery

(particularly with the grouper_change_log_entry_temp table)?  Do you use

membership enable/disable?  What do the following queries give you back?

select source_id, count(*) from grouper_pit_memberships where active='T'

group by source_id having count(*)>  1;

select * from grouper_audit_entry_v where string06 in (

select pg.source_id from grouper_pit_memberships pm, grouper_pit_groups

pg

where pm.owner_id=pg.id and

pm.source_id='fb686e35f40547948dbc3a860885bde2');

select * from grouper_pit_memberships where

source_id='fb686e35f40547948dbc3a860885bde2'

You can send the results off list and sanitize the data (subject ids) if

you want.

Thanks!

-- Shilen

On 10/31/12 6:39 AM, "Gasperowicz Jérémy"

  wrote:

Hi,

I'm getting an error when I run the loader job and I don't know where

may be the source of problem, why i'm having multiple result

Here is the error :

2012-10-30 16:03:50,058: [DefaultQuartzScheduler_Worker-6] ERROR

GrouperLoaderJob.runJob(406) -  - Error on job:

CHANGE_LOG_changeLogTempToChangeLog

edu.internet2.middleware.grouper.internal.dao.GrouperDAOException:

Problem in HibernateSession: HibernateSession: isNew: false,

isReadonly:

false, grouperTransactionType: READ_WRITE_NEW,

Exception in uniqueResult: (class

edu.internet2.middleware.grouper.pit.PITMembership), ByHqlStatic,

query:

'select pitMembership from PITMembership as pitMembership where

pitMembership.sourceId = :id and activeDb = 'T'', cacheable: true,

cacheRegion:

edu.internet2.middleware.grouper.internal.dao.hib3.Hib3PITMembershipDAO.

Fi

ndBySourceIdActive,

tx type: null, tx type: nullBind var[0]: 'Param (class

java.lang.String): 'id'->'fb686e35f40547948dbc3a860885bde2', ,

Problem in HibernateSession: HibernateSession: isNew: true, isReadonly:

false, grouperTransactionType: READ_WRITE_NEW

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hi

be

rnateSessionCatch(HibernateSession.java:495)

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibe

rn

ateSession(HibernateSession.java:581)

     at

edu.internet2.middleware.grouper.hibernate.ByHqlStatic.uniqueResult(ByHq

lS

tatic.java:323)

     at

edu.internet2.middleware.grouper.internal.dao.hib3.Hib3PITMembershipDAO.

fi

ndBySourceIdActive(Hib3PITMembershipDAO.java:70)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.process

Me

mbershipDelete(ChangeLogTempToEntity.java:744)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.access$

18

00(ChangeLogTempToEntity.java:59)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity$1.callb

ac

k(ChangeLogTempToEntity.java:137)

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibe

rn

ateSession(HibernateSession.java:571)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.convert

Re

cords(ChangeLogTempToEntity.java:91)

     at

edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$4.runJob(G

ro

uperLoaderType.java:550)

     at

edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(Grou

pe

rLoaderJob.java:398)

     at

edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(Gro

up

erLoaderJob.java:300)

     at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

     at

org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java

:5

29)

Caused by: org.hibernate.NonUniqueResultException: query did not return

a unique result: 2

     at

org.hibernate.impl.AbstractQueryImpl.uniqueElement(AbstractQueryImpl.jav

a:

899)

     at

org.hibernate.impl.AbstractQueryImpl.uniqueResult(AbstractQueryImpl.java

:8

90)

     at

edu.internet2.middleware.grouper.hibernate.ByHql.uniqueResult(ByHql.java

:2

57)

     at

edu.internet2.middleware.grouper.hibernate.ByHqlStatic$1.callback(ByHqlS

ta

tic.java:332)

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibe

rn

ateSession(HibernateSession.java:571)

     ... 12 more

2012-10-30 16:03:50,062: [DefaultQuartzScheduler_Worker-6] ERROR

GrouperLoaderJob.execute(303) -  - Error running up job

edu.internet2.middleware.grouper.internal.dao.GrouperDAOException:

Problem in HibernateSession: HibernateSession: isNew: false,

isReadonly:

false, grouperTransactionType: READ_WRITE_NEW,

Exception in uniqueResult: (class

edu.internet2.middleware.grouper.pit.PITMembership), ByHqlStatic,

query:

'select pitMembership from PITMembership as pitMembership where

pitMembership.sourceId = :id and activeDb = 'T'', cacheable: true,

cacheRegion:

edu.internet2.middleware.grouper.internal.dao.hib3.Hib3PITMembershipDAO.

Fi

ndBySourceIdActive,

tx type: null, tx type: nullBind var[0]: 'Param (class

java.lang.String): 'id'->'fb686e35f40547948dbc3a860885bde2', ,

Problem in HibernateSession: HibernateSession: isNew: true, isReadonly:

false, grouperTransactionType: READ_WRITE_NEW

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hi

be

rnateSessionCatch(HibernateSession.java:495)

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibe

rn

ateSession(HibernateSession.java:581)

     at

edu.internet2.middleware.grouper.hibernate.ByHqlStatic.uniqueResult(ByHq

lS

tatic.java:323)

     at

edu.internet2.middleware.grouper.internal.dao.hib3.Hib3PITMembershipDAO.

fi

ndBySourceIdActive(Hib3PITMembershipDAO.java:70)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.process

Me

mbershipDelete(ChangeLogTempToEntity.java:744)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.access$

18

00(ChangeLogTempToEntity.java:59)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity$1.callb

ac

k(ChangeLogTempToEntity.java:137)

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibe

rn

ateSession(HibernateSession.java:571)

     at

edu.internet2.middleware.grouper.changeLog.ChangeLogTempToEntity.convert

Re

cords(ChangeLogTempToEntity.java:91)

     at

edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$4.runJob(G

ro

uperLoaderType.java:550)

     at

edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(Grou

pe

rLoaderJob.java:398)

     at

edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(Gro

up

erLoaderJob.java:300)

     at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

     at

org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java

:5

29)

Caused by: org.hibernate.NonUniqueResultException: query did not return

a unique result: 2

     at

org.hibernate.impl.AbstractQueryImpl.uniqueElement(AbstractQueryImpl.jav

a:

899)

     at

org.hibernate.impl.AbstractQueryImpl.uniqueResult(AbstractQueryImpl.java

:8

90)

     at

edu.internet2.middleware.grouper.hibernate.ByHql.uniqueResult(ByHql.java

:2

57)

     at

edu.internet2.middleware.grouper.hibernate.ByHqlStatic$1.callback(ByHqlS

ta

tic.java:332)

     at

edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibe

rn

ateSession(HibernateSession.java:571)

     ... 12 more

Any ideas ? misconfiguration ?

Jérémy