Grouper Users - Open Discussion List

[Colin Hudler <>]

Here's a better stacktrace showing who did it

Caused by: 
edu.internet2.middleware.grouper.exception.MembershipNotFoundException: 
Exception in save: edu.internet2.middleware.grouper.Membership, 
edu.internet2.middleware.grouper.hibernate.ByObject@111cf3c,
Problem in HibernateSession: HibernateSession: isNew: false, isReadonly: 
false, grouperTransactionType: READ_WRITE_NEW,
Exception in save: edu.internet2.middleware.grouper.Membership, 
ByObjectStatic, query: ', cacheable: null, cacheRegion: null, 
entityName: ImmediateMembershipEntry, tx type: null
        at 
edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO.findByGroupOwnerAndMemberAndFieldAndType(Hib3MembershipDAO.java:937)
        at 
edu.internet2.middleware.grouper.Membership.fixComposites(Membership.java:2141)
        at 
edu.internet2.middleware.grouper.Membership.processPostMembershipSaveOrUpdate(Membership.java:2049)
        at 
edu.internet2.middleware.grouper.Membership.onPostSave(Membership.java:1884)
        at 
edu.internet2.middleware.grouper.hibernate.ByObject.save(ByObject.java:202)
        at 
edu.internet2.middleware.grouper.hibernate.ByObjectStatic$7.callback(ByObjectStatic.java:466)
        at 
edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:500)
        at 
edu.internet2.middleware.grouper.hibernate.ByObjectStatic.save(ByObjectStatic.java:453)
        at 
edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO.save(Hib3MembershipDAO.java:1471)
        at 
edu.internet2.middleware.grouper.Membership.internal_addImmediateMembership(Membership.java:1164)
        at 
edu.internet2.middleware.grouper.Group$2.callback(Group.java:860)

fixComposites is loading with some bad arguments or some 
impartial/corrupt db rows, memberlist or something like that. From this 
it should be possible to follow it backwards.

On 2/6/12 4:12 PM, Colin Hudler wrote:
> I can't even see exactly where the exception is thrown. Why 
> MembershipNotFoundException for addMember()? I can see it is ByObject 
> save(), but what's really throwing it? Not being able to find it is 
> driving me mad. I thought perhaps doPreSave() in Membership class, but 
> that doesn't seem possible.
>
> On 2/6/12 4:01 PM, Colin Hudler wrote:
> > Shilen,
> >
> > Thanks for looking. The two SQL queries returned zero rows. Here's 
> > the output from the GSH command.
> >
> > gsh 0% new 
> > edu.internet2.middleware.grouper.misc.AddMissingGroupSets().saveUpdates(false).addAllMissingGroupSets();
> >
> >
> > Searching for missing self groupSets for attribute defs
> > Found 0 missing groupSets
> >
> >
> > Searching for all composite groups to cache for later use
> > Searching for missing self groupSets for groups
> > Found 0 missing groupSets
> >
> >
> > Searching for missing self groupSets for stems
> > Found 0 missing groupSets
> >
> >
> > Searching for missing immediate groupSets where the owner is an 
> > attribute def
> > Found 0 missing groupSets
> >
> >
> > Searching for missing immediate groupSets where the owner is a group
> > Found 0 missing groupSets
> >
> >
> > Searching for missing immediate groupSets where the owner is a stem
> > Found 0 missing groupSets
> >
> > On 2/6/12 3:29 PM, Shilen Patel wrote:
> > > What happens if you run the following using GSH?
> > >
> > > new
> > > edu.internet2.middleware.grouper.misc.AddMissingGroupSets().saveUpdates(fal 
> > >
> > > se).addAllMissingGroupSets()
> > >
> > > And do either of these SQL queries give you anything back?
> > >
> > > select * from grouper_composites where owner not in (select owner_id 
> > > from
> > > grouper_group_set where mship_type='composite' and depth='0');
> > > select * from grouper_group_set where mship_type='composite' and 
> > > depth='0'
> > > and owner_id not in (select owner from grouper_composites);
> > >
> > >
> > > I'm wondering if your database may be missing some groupSets somehow,
> > > which can lead to odd issues like the ones you've described.
> > >
> > > Thanks!
> > >
> > > -- Shilen
> > >
> > >
> > > On 2/6/12 3:10 PM, "Colin 
> > > Hudler"<>
> > >   wrote:
> > >
> > > > Thanks for asking. It is a nice piece of the puzzle. It finds a lot of
> > > > "bad" memberships in some composite groups, but nothing is output for
> > > > this group.
> > > >
> > > > The findbad utility is something else I've been puzzling over for a
> > > > while; it often reports the same bad groups even when they have been
> > > > freshly recreated and *nothing else* in the registry has changed. It
> > > > does not consistently identify the same groups as bad between runs,
> > > > although they are always large composite. A couple of times it output
> > > > entirely different "bad" groups. However, mostly it identifies the 
> > > > same
> > > > list, but they seem unfixable.
> > > >
> > > > On one occasion, I suspect that the delComposite/addComposite GSH 
> > > > script
> > > > utterly destroyed the membership for the group referenced below, 
> > > > which I
> > > > am now attempting to repair. I know that there's more to the story,
> > > > since that wouldn't be possible in theory. However, I verified that 
> > > > none
> > > > of our automations modified the group, and the audit log claims the
> > > > membership was not changed (although it is empty, down from about 
> > > > 18k).
> > > >
> > > > On 2/6/12 1:48 PM, Chris Hyzer wrote:
> > > > > What happens when you run the bad membership finder?
> > > > >
> > > > >
> > > > > https://spaces.internet2.edu/display/Grouper/Bad+Membership+Finder+Utilit 
> > > > >
> > > > > y
> > > > >
> > > > > Thanks,
> > > > > Chris
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: 
> > > > >
> > > > > [mailto:] On Behalf Of Colin 
> > > > > Hudler
> > > > > Sent: Monday, February 06, 2012 2:36 PM
> > > > > To: 
> > > > >
> > > > > Subject: [grouper-users] save certain member to a group ->
> > > > > MembershipNotFoundException
> > > > >
> > > > > Grouper 1.6.3. A group that worked fine until today stopped allowing
> > > > > addition of some members. I can add many members except a few, but I
> > > > > don't know why only some cannot be added. Using API, UI, or GSH, the
> > > > > following error happens:
> > > > >
> > > > >
> > > > > edu/internet2/middleware/grouper/Group.java:877:in `callback':
> > > > > java.lang.RuntimeException:
> > > > > edu.internet2.middleware.grouper.exception.MembershipNotFoundException: 
> > > > >
> > > > > Exception in save: edu.internet2.middleware.grouper.Membership,
> > > > > edu.internet2.middleware.grouper.hibernate.ByObject@3097aa41,
> > > > > (NativeException)
> > > > > Problem in HibernateSession: HibernateSession: isNew: false, 
> > > > > isReadonly:
> > > > > false, grouperTransactionType: READ_WRITE_NEW,
> > > > > Exception in save: edu.internet2.middleware.grouper.Membership,
> > > > > ByObjectStatic, query: ', cacheable: null, cacheRegion: null,
> > > > > entityName: ImmediateMembershipEntry, tx type: null,
> > > > > , group name: uc:Reference:affiliations:effective:student, subject:
> > > > > Subject id: 30876453U, sourceId: ucmcdb, field: members,
> > > > > Problem in HibernateSession: HibernateSession: isNew: true, 
> > > > > isReadonly:
> > > > > false, grouperTransactionType: READ_WRITE_NEW
> > > > >            from
> > > > > edu/internet2/middleware/grouper/hibernate/HibernateSession.java:500:in 
> > > > >
> > > > > `callbackHibernateSession'
> > > > >            from edu/internet2/middleware/grouper/Group.java:832:in
> > > > > `internal_addMember'
> > > > >            from edu/internet2/middleware/grouper/Group.java:785:in
> > > > > `addMember'
> > > > >            from edu/internet2/middleware/grouper/Group.java:704:in
> > > > > `addMember'
> > > > >            from edu/internet2/middleware/grouper/Group.java:667:in
> > > > > `addMember'
> > > > >          ....
> > > > >
> > > > > It always happens and always for the same subjects. Thousands of 
> > > > > other
> > > > > subjects can be added or removed from the group. Any help?