Grouper Users - Open Discussion List

[Chris Hyzer <>]

Hmm, is there no more stack to it?  IF there is any more to the error message 
please send.

Also, maybe you need to turn off include/exclude in grouper.properties before 
doing an import:

grouperIncludeExclude.use = false
grouperIncludeExclude.requireGroups.use = false

Might want to look at your hooks and decide if you need to disable those 
during import or not...  :)

Let me know if that helps at all...  if you can securely send me your xml 
file, I can debug it here and send you a fix...

Thanks,
Chris


-----Original Message-----
From: Dominique Petitpierre 
[mailto:]
 
Sent: Thursday, March 14, 2013 11:54 AM
To: 
;
 Chris Hyzer
Subject: Re: [grouper-users] gsh -xmlimport failing with "Error doing 
include/exclude on group"

Hello,

On 03/14/2013 05:04 AM, Chris Hyzer wrote:
>
> Can you send me the full stack trace?

Here it is:

grouper import: reading document: /var/tmp/all-grouper-test1.xml, 
version: 1.6.3
XML file contains 539 742 records
23:49:55: Beginning import: database contains 477 records
23:50:25: completed 1 827 of 539 742 (0%) estimated time done: 02:17
23:50:55: completed 3 912 of 539 742 (1%) estimated time done: 02:07
23:51:25: completed 6 099 of 539 742 (1%) estimated time done: 02:02
23:51:55: completed 8 267 of 539 742 (2%) estimated time done: 02:00
23:52:25: completed 10 366 of 539 742 (2%) estimated time done: 02:00
23:52:55: completed 12 716 of 539 742 (2%) estimated time done: 01:57
23:53:25: completed 14 944 of 539 742 (3%) estimated time done: 01:56
23:53:55: completed 17 289 of 539 742 (3%) estimated time done: 01:54
23:54:25: completed 19 227 of 539 742 (4%) estimated time done: 01:56
23:54:55: completed 20 838 of 539 742 (4%) estimated time done: 01:59
23:55:25: completed 22 563 of 539 742 (4%) estimated time done: 02:01
23:55:55: completed 24 732 of 539 742 (5%) estimated time done: 02:00
23:56:25: completed 26 970 of 539 742 (5%) estimated time done: 02:00
23:56:55: completed 28 794 of 539 742 (5%) estimated time done: 02:01
23:57:25: completed 30 571 of 539 742 (6%) estimated time done: 02:02
23:57:55: completed 32 613 of 539 742 (6%) estimated time done: 02:02
23:58:25: completed 34 717 of 539 742 (6%) estimated time done: 02:02
23:58:55: completed 36 871 of 539 742 (7%) estimated time done: 02:01
23:59:25: completed 39 012 of 539 742 (7%) estimated time done: 02:01
23:59:55: completed 41 177 of 539 742 (8%) estimated time done: 02:01
00:00:25: completed 42 774 of 539 742 (8%) estimated time done: 02:02
00:00:55: completed 44 499 of 539 742 (8%) estimated time done: 02:03
00:01:25: completed 45 499 of 539 742 (8%) estimated time done: 02:06
Wrote record report log to: 
/var/tmp/grouperImportRecordReport_2013_03_12__23_48_35_249.txt
Exception in thread "main" java.lang.RuntimeException: 
java.lang.reflect.InvocationTargetException
         at 
edu.internet2.middleware.grouper.app.gsh.GrouperShell.handleSpecialCase(GrouperShell.java:214)
         at 
edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:144)
         at 
edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31)
Caused by: java.lang.reflect.InvocationTargetException
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:597)
         at 
edu.internet2.middleware.grouper.app.gsh.GrouperShell.handleSpecialCase(GrouperShell.java:204)
         ... 2 more
Caused by: java.lang.RuntimeException: Problem reading file: 
/var/tmp/all-grouper-test1.xml,
Problem in HibernateSession: HibernateSession: isNew: true, isReadonly: 
true, grouperTransactionType: NONE
         at 
edu.internet2.middleware.grouper.xml.importXml.XmlImportMain$3.callback(XmlImportMain.java:567)
         at 
edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:571)
         at 
edu.internet2.middleware.grouper.xml.importXml.XmlImportMain.processXmlSecondPass(XmlImportMain.java:504)
         at 
edu.internet2.middleware.grouper.xml.importXml.XmlImportMain.processXml(XmlImportMain.java:252)
         at 
edu.internet2.middleware.grouper.xml.importXml.XmlImportMain.processXml(XmlImportMain.java:206)
         at 
edu.internet2.middleware.grouper.xml.importXml.XmlImportGsh.main(XmlImportGsh.java:130)
         ... 7 more
Caused by: org.dom4j.DocumentException: Error doing include/exclude on 
group: bd89a126c69447c28dbc3c628d695cc6,
Hook GroupTypeTupleIncludeExcludeHook.groupTypeTuplePostInsert id: ROHXS09B,
Exception in save: edu.internet2.middleware.grouper.GroupTypeTuple, 
edu.internet2.middleware.grouper.hibernate.ByObject@1293073,
Problem in HibernateSession: HibernateSession: isNew: true, isReadonly: 
false, grouperTransactionType: READ_WRITE_NEW,
Exception in save: edu.internet2.middleware.grouper.GroupTypeTuple, 
ByObjectStatic, query: ', cacheable: null, cacheRegion: null, 
entityName: null, tx type: null Nested exception: Error doing 
include/exclude on group: bd89a126c69447c28dbc3c628d695cc6,
Hook GroupTypeTupleIncludeExcludeHook.groupTypeTuplePostInsert id: ROHXS09B,
Exception in save: edu.internet2.middleware.grouper.GroupTypeTuple, 
edu.internet2.middleware.grouper.hibernate.ByObject@1293073,
Problem in HibernateSession: HibernateSession: isNew: true, isReadonly: 
false, grouperTransactionType: READ_WRITE_NEW,
Exception in save: edu.internet2.middleware.grouper.GroupTypeTuple, 
ByObjectStatic, query: ', cacheable: null, cacheRegion: null, 
entityName: null, tx type: null
         at org.dom4j.io.SAXReader.read(SAXReader.java:484)
         at org.dom4j.io.SAXReader.read(SAXReader.java:365)
         at 
edu.internet2.middleware.grouper.xml.importXml.XmlImportMain$3.callback(XmlImportMain.java:549)
         ... 12 more



And here is some extracts of an old style xmlexport relevant to the
uuid bd89a126c69447c28dbc3c628d695cc6 showing the group structure (in
a more readily legible way than the new style export :-) ) :

.....................
              <!-- 
&apos;unige.ch:affiliation:unigechpersonaffiliation:secfacses_systemOfRecordAndIncludes&apos;
 
-->
             <group extension='secfacses_systemOfRecordAndIncludes'
               displayExtension='secfacses system of record and includes'
 
name='unige.ch:affiliation:unigechpersonaffiliation:secfacses_systemOfRecordAndIncludes'
 
displayName='UniGE:Affiliation:unigeChPersonAffiliation:secfacses system 
of record and includes'
               id='4cff5f0952964b108dc671c9972658f1'
               contextId='4496d0fc555e4eceaf69f4d8f6ff1f8e'
             >
               <description>Internal utility group for group secfacses 
which facilitates the group math for the include and exclude 
lists</description>
              <internalAttributes>
                 <internalAttribute 
name='parentStem'>unige.ch:affiliation:unigechpersonaffiliation</internalAttribute>
                 <internalAttribute name='createSubject'>
                   <subject id='GrouperSystem' type='application' 
source='g:isa'/>
                 </internalAttribute>
                 <internalAttribute 
name='createTime'>1310662283847</internalAttribute> <!-- Thu Jul 14 
18:51:23 MEST 2011 -->
                 <internalAttribute name='modifySubject'>
                   <subject id='GrouperSystem' type='application' 
source='g:isa'/>
                 </internalAttribute>
                 <internalAttribute 
name='modifyTime'>1310662283960</internalAttribute> <!-- Thu Jul 14 
18:51:23 MEST 2011 -->
               </internalAttributes>

               <list field='members' groupType='base'>
               <subject 
identifier='unige.ch:affiliation:unigechpersonaffiliation:secfacses_systemOfRecord'
 
type='group' source='g:gsa' immediate='true' 
id='bd89a126c69447c28dbc3c628d695cc6'
/>

               <subject 
identifier='unige.ch:affiliation:unigechpersonaffiliation:secfacses_includes' 
type='group' source='g:gsa' immediate='true' 
id='a596e5dadba949d8b7288367e98f746f'
/>

               <subject 
'
 type='person' 
source='people-test.unige.ch' immediate='false'
/>
.....................
            <!-- 
&apos;unige.ch:affiliation:unigechpersonaffiliation:secfacses_systemOfRecord&apos;
 
-->
             <group extension='secfacses_systemOfRecord'
               displayExtension='secfacses_systemOfRecord'
 
name='unige.ch:affiliation:unigechpersonaffiliation:secfacses_systemOfRecord'
 
displayName='UniGE:Affiliation:unigeChPersonAffiliation:secfacses_systemOfRecord'
               id='bd89a126c69447c28dbc3c628d695cc6'
               contextId='6c3f7b968a9a4ec883e710bcb3783369'
             >
               <description>secfacses_systemOfRecord auto-created by 
grouperLoader</description>
               <internalAttributes>
                 <internalAttribute 
name='parentStem'>unige.ch:affiliation:unigechpersonaffiliation</internalAttribute>
                 <internalAttribute name='createSubject'>
                   <subject id='GrouperSystem' type='application' 
source='g:isa'/>
                 </internalAttribute>
                 <internalAttribute 
name='createTime'>1310662283272</internalAttribute> <!-- Thu Jul 14 
18:51:23 MEST 2011 -->
                 <internalAttribute name='modifySubject'>
                   <subject id='GrouperSystem' type='application' 
source='g:isa'/>
                 </internalAttribute>
                 <internalAttribute 
name='modifyTime'>1310662283404</internalAttribute> <!-- Thu Jul 14 
18:51:23 MEST 2011 -->
               </internalAttributes>

               <groupTypes>
                 <groupType name='addIncludeExclude'>
                 </groupType>

               </groupTypes>
               <list field='members' groupType='base'>
               <subject 
'
 type='person' 
source='people-test.unige.ch' immediate='true'
/>
.....................



In case it matters, the group secfacses_systemOfRecord is created and 
provisioned by a
grouperLoader job (SQL_GROUP_LIST).


Thanks for your help!

-- 
Mr Dominique Petitpierre, user=Dominique.Petitpierre domain=unige.ch
IT Division, University of Geneva, Switzerland