grouper-users - [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4

Subject: Grouper Users - Open Discussion List

List archive

[grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4

From: "Redman, Chad" <>
To: "Crawford, Jeffrey" <>, "Hyzer, Chris" <>, " Mailing List" <>
Subject: [grouper-users] RE: Trouble upgrading Grouper DB from 2.1 to 2.4
Date: Tue, 20 Nov 2018 22:09:17 +0000
Accept-language: en-US
Authentication-results: spf=none (sender IP is ) ;
Ironport-phdr: 9a23:vL8kSREoX5gGxFDWZl7slZ1GYnF86YWxBRYc798ds5kLTJ76psuzbnLW6fgltlLVR4KTs6sC17KG9fi4EUU7or+5+EgYd5JNUxJXwe43pCcHRPC/NEvgMfTxZDY7FskRHHVs/nW8LFQHUJ2mPw6arXK99yMdFQviPgRpOOv1BpTSj8Oq3Oyu5pHfeQpFiCa+bL9oMBm6sRjau9ULj4dlNqs/0AbCrGFSe+RRy2NoJFaTkAj568yt4pNt8Dletuw4+cJYXqr0Y6o3TbpDDDQ7KG81/9HktQPCTQSU+HQRVHgdnwdSDAjE6BH6WYrxsjf/u+Fg1iSWIdH6QLYpUjm58axlVAHnhzsGNz4h8WHYlMpwjL5AoBm8oxBz2pPYbJ2JOPZ7eK7WYNEUSndbXstJVyJPHJ6yb5cBAeQCM+ZXrYj9qEcBohalHwagGP/jxyVUinPq36A31fkqHwHc3AwnGtIDqHrYosnrO6gPVOC61q/IwS3eZP5I2Tfy8pXHfh48qvyLQb1wcdDexlQ3GAPfkFqftInlMCmT1ukWrmib6fZvWfixhGE6tgF8uz6izdoihInOg4Ia0FHE9SNhzYY6P924T1N7Yca/EJRKqSGVKZF6Qtg4TGF2pik20rIGuYS8fCgX0JQo2QTfZ+adfIiQ+hLvTPyeIStkhHJ/ebKwnAuy8VS+xeLhSMa03k1KoTBbktbSrHwNzAbc6taZRfZ740yv2i6P2hjN5u5ePUw4iK/WJ4M8zrItk5cTv0vOEjPqlEjzgq+ZaEop9+et5uniY7jquIKQO5dphgz+LKgigNKzDf4lPgQSQWSX4/mw2bLg8EHhTrVFkP47nrXcvZ3fKskXu7K2AwFQ34k99RmzEyqp3dEXkHYcMF5IeheKgof3N13TPP/1C+q0jU62nzdx3f/GO6XsApXTIXjHl7fsZa5z5lJbxgYv09xT/o9aBKkcLP7qXU/+r8LXAgU+Mwyp3+boE9J91p4YWW2SGKOZKLnSsViU5u0xP+aMeI4VuDH7K/Q/4P7ukGM5mVsafamu3psbcmy3HvNjI0mBYHrshMkOEXsSswYgVuPmlECOXDtOa3qvQq4x4z87BY26AYvfQ42tjqKO0Si0E5BTY21LC06AHWrwe4WBQfgMaSaSIsF7kjwDULisU5Mu1RG0uwDn07VnNPTb9TAdtZ350th4/PDTlRcu+jBuEcuSznyNQ3lunmwUXz82wLx/oUtlx1eMy6h4hOFYFcRN6PNTSws6KIXcwPJgC9DpQQ/BetaJSE26QtW9Hz09VNMxw9kSY0ljAdWiiA7M3za0D7MPibOEGYE0oerg2C27DNx01HjBzqVlx3srTMVVOHzszvp9/BLaGIDOiUmxlrrsaK8Y1WjA+HrViSLEnFBKXRQ0GY7FR3EELAOCqN/591HPVZevEr9hLxNMz8jEJ6dXPJmhx1pcQ+r7Nc6bfnm8gXyYBBCUy6mKYZawPWgRwW34AUkAkgYctVKHLhR0TnOuuWXDFDF0UE/0bln32eh4tH6hSEIolUeHY1A3hJSv/RtAz8aRR/Ya2PZMkycop388SF291t7hEdeMogNnVLhaapUw7EoRhjGRjBB0IpH1d/MqvVUZaQki+hq2j08tWIxdjcgnqm8rxwNuKKWelUlMbC6cwYuuYO/MMmen+hepZuaWwVzY3NuMsoY3oPUj4xSG3kmyE1Y6tXBu0t1byXyZs57KBQYlS5/9V08x3wV8rPfXbjRur44=
Spamdiagnosticmetadata: NSPM
Spamdiagnosticoutput: 1:99

If it helps, this is the query the error translates to. Does this work from SQL? Logged in as iamucla_grouper_d?

/* edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO#findAllByGroupOwnerAndMember */

select ms.*, m.* from grouper_memberships_all_v as ms, grouper_members as m

where ms.owner_attr_def_id = '80075426c19b41758c65e6a6e74c6a9a'

and ms.member_id = '496458b5c1ca4757ab70541f15d3ec34'

and ms.member_id = m.id and ms.immediate_mship_enabled = 'T';

From: [mailto:] On Behalf Of Crawford, Jeffrey
Sent: Tuesday, November 20, 2018 2:41 PM
To: Hyzer, Chris <>; Mailing List <>
Subject: [grouper-users] Re: Trouble upgrading Grouper DB from 2.1 to 2.4

Maybe it’s just easier to post the errors I got:

./bin/gsh.sh

Using GROUPER_HOME: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF

Using GROUPER_CONF: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes

Using JAVA: /usr/java/jdk1.8.0_191-amd64/bin/java

using MEMORY: 64m-750m

log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.DailyRollingFileAppender.

Grouper starting up: version: 2.4.0, build date: 2018/08/23 07:48:38, env: <no label configured>

grouperPatchStatus read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/grouperPatchStatus.properties

api patches installed: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9

ui patches installed: 0, 1, 2, 3, 4

grouper.properties read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/grouper.properties

Grouper current directory is: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF

log4j.properties read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/log4j.properties

Grouper is logging to file: /opt/grouper-2.4.0/apache-tomcat-8.5.12/logs/grouperUi/grouper_error.log, at min level WARN for package: edu.internet2.middleware.grouper, based on log4j.properties

grouper.hibernate.properties: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/grouper.hibernate.properties

grouper.hibernate.properties:

subject.properties read from: /opt/grouper-2.4.0/grouper.ui-2.4.0/dist/grouper/WEB-INF/classes/subject.properties

sources configured in: subject.properties

subject.properties ldap source id: ldap: personLdap

subject.properties groupersource id: g:gsa

subject.properties groupersource id: grouperEntities

Grouper warning: cannot find group from config: deprovisioning admin group can deprovision from all groups/objects in Grouper even if the user is not a Grouper overall SysAdmin: etc:deprovisioning:deprovisioningAdmins

Grouper error: etc:deprovisioning:deprovisioningAdmins, edu.internet2.middleware.grouper.internal.dao.GrouperDAOException: Problem in HibernateSession: HibernateSession (741741d0): notNew, notReadonly, READ_WRITE_NEW, activeTransaction, session (45a1d057),

Exception in list: (class [Ljava.lang.Object;), ByHqlStatic, query: 'select ms, m from MembershipEntry as ms, Member as m where ms.ownerGroupId = :owner and ms.memberUuid = :member and ms.memberUuid = m.uuid and ms.enabledDb = 'T'', cacheable: false, cacheRegion: edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO, tx type: null, tx type: nullBind var[0]: 'Param (class java.lang.String): 'owner'->'8a101d8652034ff886576fd141f0cb70'Bind var[1]: 'Param (class java.lang.String): 'member'->'496458b5c1ca4757ab70541f15d3ec34', ,

Problem in HibernateSession: HibernateSession (1d98daa0): new, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (45a1d057),

Problem saving group: etc:deprovisioning:deprovisioningAdmins, thread: 2d6e8792

at edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hibernateSessionCatch(HibernateSession.java:589)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:711)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.list(ByHqlStatic.java:407)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.listSet(ByHqlStatic.java:458)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO.findAllByGroupOwnerAndMember(Hib3MembershipDAO.java:1805)

at edu.internet2.middleware.grouper.privs.GrouperNonDbAccessAdapter.getPrivs(GrouperNonDbAccessAdapter.java:248)

at edu.internet2.middleware.grouper.privs.AccessWrapper.getPrivileges(AccessWrapper.java:139)

at edu.internet2.middleware.grouper.privs.GrouperAllAccessResolver.getPrivileges(GrouperAllAccessResolver.java:127)

at edu.internet2.middleware.grouper.privs.GrouperSystemAccessResolver.getPrivileges(GrouperSystemAccessResolver.java:109)

at edu.internet2.middleware.grouper.privs.CachingAccessResolver.getPrivileges(CachingAccessResolver.java:101)

at edu.internet2.middleware.grouper.privs.CachingAccessResolver.hasPrivilege(CachingAccessResolver.java:160)

at edu.internet2.middleware.grouper.privs.WheelAccessResolver.hasPrivilege(WheelAccessResolver.java:345)

at edu.internet2.middleware.grouper.privs.ValidatingAccessResolver.hasPrivilege(ValidatingAccessResolver.java:150)

at edu.internet2.middleware.grouper.Group.hasRead(Group.java:4525)

at edu.internet2.middleware.grouper.GroupSave$1$1.callback(GroupSave.java:642)

at edu.internet2.middleware.grouper.GrouperSession.callbackGrouperSession(GrouperSession.java:974)

at edu.internet2.middleware.grouper.GroupSave$1.callback(GroupSave.java:444)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO$1.callback(Hib3TransactionDAO.java:66)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:701)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO.transactionCallback(Hib3TransactionDAO.java:56)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:87)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:106)

at edu.internet2.middleware.grouper.GroupSave.save(GroupSave.java:435)

at edu.internet2.middleware.grouper.Group.saveGroup(Group.java:366)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkGroup(GrouperCheckConfig.java:221)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkGroups(GrouperCheckConfig.java:853)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkConfig(GrouperCheckConfig.java:499)

at edu.internet2.middleware.grouper.misc.GrouperStartup.startup(GrouperStartup.java:315)

at edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:165)

at edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31)

Caused by: org.hibernate.exception.SQLGrammarException: could not extract ResultSet

at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:63)

at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42)

at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:109)

at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:95)

at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:79)

at org.hibernate.loader.Loader.getResultSet(Loader.java:2117)

at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:1900)

at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:1876)

at org.hibernate.loader.Loader.doQuery(Loader.java:919)

at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:336)

at org.hibernate.loader.Loader.doList(Loader.java:2617)

at org.hibernate.loader.Loader.doList(Loader.java:2600)

at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2429)

at org.hibernate.loader.Loader.list(Loader.java:2424)

at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:501)

at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:371)

at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:216)

at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1326)

at org.hibernate.internal.QueryImpl.list(QueryImpl.java:87)

at edu.internet2.middleware.grouper.hibernate.ByHql.list(ByHql.java:380)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic$2.callback(ByHqlStatic.java:417)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:701)

... 28 more

Caused by: java.sql.SQLSyntaxErrorException: ORA-00942: table or view does not exist

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:459)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:400)

at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:999)

at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:539)

at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:235)

at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:543)

at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:239)

at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:1246)

at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1500)

at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1717)

at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:4401)

at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:4482)

at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:6272)

at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeQuery(NewProxyPreparedStatement.java:353)

at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:70)

... 45 more

Couldnt startup grouper: Problem in HibernateSession: HibernateSession (7ce29a2d): notNew, notReadonly, READ_WRITE_NEW, activeTransaction, session (243bf087),

Exception in list: (class [Ljava.lang.Object;), ByHqlStatic, query: 'select ms, m from MembershipEntry as ms, Member as m where ms.ownerAttrDefId = :owner and ms.memberUuid = :member and ms.memberUuid = m.uuid and ms.enabledDb = 'T'', cacheable: false, cacheRegion: edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO, tx type: null, tx type: nullBind var[0]: 'Param (class java.lang.String): 'owner'->'80075426c19b41758c65e6a6e74c6a9a'Bind var[1]: 'Param (class java.lang.String): 'member'->'496458b5c1ca4757ab70541f15d3ec34', ,

Problem in HibernateSession: HibernateSession (634ca3e7): new, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (243bf087)

edu.internet2.middleware.grouper.internal.dao.GrouperDAOException: Problem in HibernateSession: HibernateSession (7ce29a2d): notNew, notReadonly, READ_WRITE_NEW, activeTransaction, session (243bf087),

Problem in HibernateSession: HibernateSession (634ca3e7): new, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (243bf087)

at edu.internet2.middleware.grouper.hibernate.HibernateSession._internal_hibernateSessionCatch(HibernateSession.java:589)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:711)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.list(ByHqlStatic.java:407)

at edu.internet2.middleware.grouper.hibernate.ByHqlStatic.listSet(ByHqlStatic.java:458)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3MembershipDAO.findAllByAttrDefOwnerAndMember(Hib3MembershipDAO.java:2542)

at edu.internet2.middleware.grouper.privs.GrouperNonDbAttrDefAdapter.getPrivs(GrouperNonDbAttrDefAdapter.java:194)

at edu.internet2.middleware.grouper.privs.AttributeDefWrapper.getPrivileges(AttributeDefWrapper.java:122)

at edu.internet2.middleware.grouper.privs.GrouperAllAttrDefResolver.getPrivileges(GrouperAllAttrDefResolver.java:99)

at edu.internet2.middleware.grouper.privs.GrouperSystemAttrDefResolver.getPrivileges(GrouperSystemAttrDefResolver.java:101)

at edu.internet2.middleware.grouper.privs.CachingAttrDefResolver.getPrivileges(CachingAttrDefResolver.java:133)

at edu.internet2.middleware.grouper.privs.CachingAttrDefResolver.hasPrivilege(CachingAttrDefResolver.java:201)

at edu.internet2.middleware.grouper.privs.WheelAttrDefResolver.hasPrivilege(WheelAttrDefResolver.java:341)

at edu.internet2.middleware.grouper.privs.ValidatingAttrDefResolver.hasPrivilege(ValidatingAttrDefResolver.java:127)

at edu.internet2.middleware.grouper.attr.AttributeDefPrivilegeDelegate.hasAttrAdmin(AttributeDefPrivilegeDelegate.java:87)

at edu.internet2.middleware.grouper.attr.AttributeDefSave$1$1.callback(AttributeDefSave.java:738)

at edu.internet2.middleware.grouper.GrouperSession.callbackGrouperSession(GrouperSession.java:974)

at edu.internet2.middleware.grouper.attr.AttributeDefSave$1.callback(AttributeDefSave.java:495)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO$1.callback(Hib3TransactionDAO.java:66)

at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:701)

at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3TransactionDAO.transactionCallback(Hib3TransactionDAO.java:56)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:87)

at edu.internet2.middleware.grouper.hibernate.GrouperTransaction.callbackGrouperTransaction(GrouperTransaction.java:106)

at edu.internet2.middleware.grouper.attr.AttributeDefSave.save(AttributeDefSave.java:488)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkAttributes(GrouperCheckConfig.java:2080)

at edu.internet2.middleware.grouper.misc.GrouperCheckConfig.checkConfig(GrouperCheckConfig.java:501)