grouper-users - Re: [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4

From: "Crawford, Jeffrey" <>
To: "Redman, Chad" <>, "Hyzer, Chris" <>, " Mailing List" <>, Shilen Patel <>
Subject: Re: [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4
Date: Tue, 20 Nov 2018 22:44:37 +0000
Accept-language: en-US
Authentication-results: spf=none (sender IP is ) ;
Ironport-phdr: 9a23:2dx89h9GJKHnef9uRHKM819IXTAuvvDOBiVQ1KB+0u4TIJqq85mqBkHD//Il1AaPAd2Lraocw8Pt8InYEVQa5piAtH1QOLdtbDQizfssogo7HcSeAlf6JvO5JwYzHcBFSUM3tyrjaRsdF8nxfUDdrWOv5jAOBBr/KRB1JuPoEYLOksi7ze+/94HQbglSmDaxfa55IQmrownWqsQYm5ZpJLwryhvOrHtIeuBWyn1tKFmOgRvy5dq+8YB6/ShItP0v68BPUaPhf6QlVrNYFygpM3o05MLwqxbOSxaE62YGXWUXlhpIBBXF7A3/U5zsvCb2qvZx1S+HNsDtU7s6RSqt4LtqSB/wiScIKTg58H3MisdtiK5XuQ+tqwBjz4LRZoyeKfhwcb7Hfd4CRWRPQNtfVzBPDI2/YYsADesBMvpXoITmvVQCsQeyCBOwCO/zyjJFgGL9060g0+QmFAHLxAIsEswUsHvOotT1OqASUfqow6XQ0D7Na+1Z2Tnz6IjSbB8gof+AVq93fMrT1UYvDRnKj1ueqYziJTOay/8As2mH7+Z6SOKgl2onpBtrrjex28gsl5DEi4QIwV7K8iV5xZw6Jdy+SENje9GkE4FfuzufN4ttRM4pXmJmuD4ix7EYo5G3YDUGxZE6yxLCdvCKdoaI7x3/WOqNJDp4imxqdb2hixu39EWtyPPwW8ms3FpXoCdJiNrBu3EX2xDO9MSLVuFx8lm91TuMzwzT5P9LLEMomafeLpMhzL49m5QXvEnGACP6hl/5gLGTe0o/5uel5ernb7Dopp+SK4N5iAfzObk0lMOlG+Q3KA0OUnCb+eui0L3j+lX0Tq1Wg/MxjqXVrYnWKNkZqaKnGgNV1Z0s5AilAzehzdQYgWIILFVYeBKBkoflIUnOIOr/DfejnVujjCtrx/HBPr3nGJnNKWXDkKvlfbZ67E5cyxA/wsxY55JREr0BIfTzVVHttNHAEBM2KRC4z/viBdlgy48SRGeCAqGWPa/OrVOF4+wvLPeDaYMLvTvwLvoo6+DugHMhnF8SZ6ip3Z8ZaHCiGfRmJl2UYXjwjdcbC2gLsAQ+TOvwiFKfSjNTZmqyU7gh5j4nDIKpF53PSZ6wj7ycxCu7BIFZZnhaClCQFnflb4qEW+0LaCKPOs9ujCYEWaG8S486yx6urhT6xqFjLurV4S0YqYnj2MZv6+3SkxEy6SJ7D96b026TU2F4gHkESCEr06Bi8gRBzQLJ66V0hvVeUZR45/pFGE9uPp7Vw9tgBtz3UwTpY9GCDluqX4PiSXsRX8A82ZtGSEZnGs7oxkTG1Cq7EbIPv72QD9op6q/a2T78K9srjz6M27MmkkErWI5SLmC8nYZ+8RTeHYjEjx/fmqq3PYEV3SrM8mjL6WuVoAsQBAFqVrjdUGpae1Dbt8/R50XeQqWoBKh9dAZN1JjGYpBKa9nkix1+TevuPJyKeGKwn2q2LRqVxb7KYYb3LTYzxiLYXQIviQkM83GcOUx2JCqvrXjTHXYmQVDkeUrz/+5kpFu6UgkpxAWDKUBtyuzmqVYumfWARqZLjfo/syA7pmAxRQ7lhYiEAsecpwdnYKRXaM8851ECz2/CqghhJcL8fbt6iAsYdAJ69wP12hN7B58IsPBirWhijW8QYbmdzEsHcjqZ2Z7qPbiCKGLo9Q+hbLTa8lDClsud/q5J5fgl+B3u
Spamdiagnosticmetadata: NSPM
Spamdiagnosticoutput: 1:99

But wouldn't running gsh -registry -check correct that?

From: Shilen Patel <>
Sent: Tuesday, November 20, 2018 2:18:47 PM
To: Redman, Chad; Crawford, Jeffrey; Hyzer, Chris; Mailing List
Subject: Re: [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4

I'm guessing since the upgrade failed (the first error that was given), the views weren't added back (which usually happens at the end of the upgrade). So all these other errors may be a side effect.

- Shilen

Sent from my Verizon, Samsung Galaxy smartphone

-------- Original message --------

From: "Redman, Chad" <>

Date: 11/20/18 5:13 PM (GMT-05:00)

To: "Crawford, Jeffrey" <>, "Hyzer, Chris" <>, " Mailing List" <>

Subject: [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4

Syntax was almost right. Try this without the "as".

select ms.*, m.* from grouper_memberships_all_v ms, grouper_members m

where ms.owner_attr_def_id = '80075426c19b41758c65e6a6e74c6a9a'

and ms.member_id = '496458b5c1ca4757ab70541f15d3ec34'

and ms.member_id = m.id and ms.immediate_mship_enabled = 'T';

From: [mailto:] On Behalf Of Redman, Chad
Sent: Tuesday, November 20, 2018 5:09 PM
To: Crawford, Jeffrey <>; Hyzer, Chris <>; Mailing List <>
Subject: [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4

If it helps, this is the query the error translates to. Does this work from SQL? Logged in as iamucla_grouper_d?

/* edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO#findAllByGroupOwnerAndMember */

select ms.*, m.* from grouper_memberships_all_v as ms, grouper_members as m

where ms.owner_attr_def_id = '80075426c19b41758c65e6a6e74c6a9a'

and ms.member_id = '496458b5c1ca4757ab70541f15d3ec34'

and ms.member_id = m.id and ms.immediate_mship_enabled = 'T';

From: [] On Behalf Of Crawford, Jeffrey
Sent: Tuesday, November 20, 2018 2:41 PM
To: Hyzer, Chris <>; Mailing List <>
Subject: [grouper-users] Re: Trouble upgrading Grouper DB from 2.1 to 2.4

Maybe it’s just easier to post the errors I got:

./bin/gsh.sh

Using GROUPER_HOME: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF

Using GROUPER_CONF: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes

Using JAVA: /usr/java/jdk1.8.0_191-amd64/bin/java

using MEMORY: 64m-750m

log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.DailyRollingFileAppender.

Grouper starting up: version: 2.4.0, build date: 2018/08/23 07:48:38, env: <no label configured>

grouperPatchStatus read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/grouperPatchStatus.properties

api patches installed: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9

ui patches installed: 0, 1, 2, 3, 4

grouper.properties read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/grouper.properties

Grouper current directory is: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF

log4j.properties read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/log4j.properties

Grouper is logging to file: /opt/grouper-2.4.0/apache-tomcat-8.5.12/logs/grouperUi/grouper_error.log, at min level WARN for package: edu.internet2.middleware.grouper, based on log4j.properties

grouper.hibernate.properties: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/grouper.hibernate.properties

grouper.hibernate.properties:

subject.properties read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/subject.properties

sources configured in: subject.properties

subject.properties ldap source id: ldap: personLdap

subject.properties groupersource id: g:gsa

subject.properties groupersource id: grouperEntities

Grouper warning: cannot find group from config: deprovisioning admin group can deprovision from all groups/objects in Grouper even if the user is not a Grouper overall SysAdmin: etc:deprovisioning:deprovisioningAdmins

Grouper error: etc:deprovisioning:deprovisioningAdmins, edu.internet2.middleware.grouper.internal.dao.GrouperDAOException: Problem in HibernateSession: HibernateSession (741741d0): notNew, notReadonly, READ_WRITE_NEW, activeTransaction, session (45a1d057),

Exception in list: (class [Ljava.lang.Object;), ByHqlStatic, query: 'select ms, m from MembershipEntry as ms, Member as m where ms.ownerGroupId = :owner and ms.memberUuid = :member and ms.memberUuid = m.uuid and ms.enabledDb = 'T'', cacheable: false, cacheRegion: edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO, tx type: null, tx type: nullBind var[0]: 'Param (class java.lang.String): 'owner'->'8a101d8652034ff886576fd141f0cb70'Bind var[1]: 'Param (class java.lang.String): 'member'->'496458b5c1ca4757ab70541f15d3ec34', ,

Problem in HibernateSession: HibernateSession (1d98daa0): new, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (45a1d057),

Problem saving group: etc:deprovisioning:deprovisioningAdmins, thread: 2d6e8792

at edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hibernateSessionCatch(HibernateSession.java:589)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:711)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.list(ByHqlStatic.java:407)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.listSet(ByHqlStatic.java:458)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO.findAllByGroupOwnerAndMember(Hib3MembershipDAO.java:1805)

at edu.internet2.middleware.grouper.privs.GrouperNonDbAccessAdapter.getPrivs(GrouperNonDbAccessAdapter.java:248)

at edu.internet2.middleware.grouper.privs.AccessWrapper.getPrivileges(AccessWrapper.java:139)

at edu.internet2.middleware.grouper.privs.GrouperAllAccessResolver.getPrivileges(GrouperAllAccessResolver.java:127)

at edu.internet2.middleware.grouper.privs.GrouperSystemAccessResolver.getPrivileges(GrouperSystemAccessResolver.java:109)

at edu.internet2.middleware.grouper.privs.CachingAccessResolver.getPrivileges(CachingAccessResolver.java:101)

at edu.internet2.middleware.grouper.privs.CachingAccessResolver.hasPrivilege(CachingAccessResolver.java:160)

at edu.internet2.middleware.grouper.privs.WheelAccessResolver.hasPrivilege(WheelAccessResolver.java:345)

at edu.internet2.middleware.grouper.privs.ValidatingAccessResolver.hasPrivilege(ValidatingAccessResolver.java:150)

at edu.internet2.middleware.grouper.Group.hasRead(Group.java:4525)

at edu.internet2.middleware.grouper.GroupSave$1$1.callback(GroupSave.java:642)

at edu.internet2.middleware.grouper.GrouperSession.callbackGrouperSession(GrouperSession.java:974)

at edu.internet2.middleware.grouper.GroupSave$1.callback(GroupSave.java:444)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO$1.callback(Hib3TransactionDAO.java:66)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:701)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO.transactionCallback(Hib3TransactionDAO.java:56)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:87)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:106)

at edu.internet2.middleware.grouper.GroupSave.save(GroupSave.java:435)

at edu.internet2.middleware.grouper.Group.saveGroup(Group.java:366)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkGroup(GrouperCheckConfig.java:221)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkGroups(GrouperCheckConfig.java:853)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkConfig(GrouperCheckConfig.java:499)

at edu.internet2.middleware.grouper.misc.GrouperStartup.startup(GrouperStartup.java:315)

at edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:165)

at edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31)

Caused by: org.hibernate.exception.SQLGrammarException: could not extract ResultSet

at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:63)

at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42)

at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:109)

at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:95)

at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:79)

at org.hibernate.loader.Loader.getResultSet(Loader.java:2117)

at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:1900)

at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:1876)

at org.hibernate.loader.Loader.doQuery(Loader.java:919)

at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:336)

at org.hibernate.loader.Loader.doList(Loader.java:2617)

at org.hibernate.loader.Loader.doList(Loader.java:2600)

at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2429)

at org.hibernate.loader.Loader.list(Loader.java:2424)

at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:501)

at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:371)

at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:216)

at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1326)

at org.hibernate.internal.QueryImpl.list(QueryImpl.java:87)

at edu.internet2.middleware.grouper.hibernate.ByHql.list(ByHql.java:380)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic$2.callback(ByHqlStatic.java:417)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:701)

... 28 more

Caused by: java.sql.SQLSyntaxErrorException: ORA-00942: table or view does not exist

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:459)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:400)

at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:999)

at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:539)

at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:235)

at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:543)

at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:239)

at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:1246)

at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1500)

at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1717)

at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:4401)

at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:4482)

at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:6272)

at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeQuery(NewProxyPreparedStatement.java:353)

at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:70)

... 45 more

Couldnt startup grouper: Problem in HibernateSession: HibernateSession (7ce29a2d): notNew, notReadonly, READ_WRITE_NEW, activeTransaction, session (243bf087),

Exception in list: (class [Ljava.lang.Object;), ByHqlStatic, query: 'select ms, m from MembershipEntry as ms, Member as m where ms.ownerAttrDefId = :owner and ms.memberUuid = :member and ms.memberUuid = m.uuid and ms.enabledDb = 'T'', cacheable: false, cacheRegion: edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO, tx type: null, tx type: nullBind var[0]: 'Param (class java.lang.String): 'owner'->'80075426c19b41758c65e6a6e74c6a9a'Bind var[1]: 'Param (class java.lang.String): 'member'->'496458b5c1ca4757ab70541f15d3ec34', ,

Problem in HibernateSession: HibernateSession (634ca3e7): new, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (243bf087)

edu.internet2.middleware.grouper.internal.dao.GrouperDAOException: Problem in HibernateSession: HibernateSession (7ce29a2d): notNew, notReadonly, READ_WRITE_NEW, activeTransaction, session (243bf087),

Problem in HibernateSession: HibernateSession (634ca3e7): new, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (243bf087)

at edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hibernateSessionCatch(HibernateSession.java:589)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:711)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.list(ByHqlStatic.java:407)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.listSet(ByHqlStatic.java:458)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO.findAllByAttrDefOwnerAndMember(Hib3MembershipDAO.java:2542)

at edu.internet2.middleware.grouper.privs.GrouperNonDbAttrDefAdapter.getPrivs(GrouperNonDbAttrDefAdapter.java:194)

at edu.internet2.middleware.grouper.privs.AttributeDefWrapper.getPrivileges(AttributeDefWrapper.java:122)

at edu.internet2.middleware.grouper.privs.GrouperAllAttrDefResolver.getPrivileges(GrouperAllAttrDefResolver.java:99)

at edu.internet2.middleware.grouper.privs.GrouperSystemAttrDefResolver.getPrivileges(GrouperSystemAttrDefResolver.java:101)

at edu.internet2.middleware.grouper.privs.CachingAttrDefResolver.getPrivileges(CachingAttrDefResolver.java:133)

at edu.internet2.middleware.grouper.privs.CachingAttrDefResolver.hasPrivilege(CachingAttrDefResolver.java:201)

at edu.internet2.middleware.grouper.privs.WheelAttrDefResolver.hasPrivilege(WheelAttrDefResolver.java:341)

at edu.internet2.middleware.grouper.privs.ValidatingAttrDefResolver.hasPrivilege(ValidatingAttrDefResolver.java:127)

at edu.internet2.middleware.grouper.attr.AttributeDefPrivilegeDelegate.hasAttrAdmin(AttributeDefPrivilegeDelegate.java:87)

at edu.internet2.middleware.grouper.attr.AttributeDefSave$1$1.callback(AttributeDefSave.java:738)

at edu.internet2.middleware.grouper.GrouperSession.callbackGrouperSession(GrouperSession.java:974)

at edu.internet2.middleware.grouper.attr.AttributeDefSave$1.callback(AttributeDefSave.java:495)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO$1.callback(Hib3TransactionDAO.java:66)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:701)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO.transactionCallback(Hib3TransactionDAO.java:56)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:87)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:106)

at edu.internet2.middleware.grouper.attr.AttributeDefSave.save(AttributeDefSave.java:488)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkAttributes(GrouperCheckConfig.java:2080)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkConfig(GrouperCheckConfig.java:501)