Grouper Users - Open Discussion List

[Rahul Doshi <>]

Shilen,

Running the SQL generated from gsh.sh -registry -deep recreated all the
missing views.  Thanks for your help.

Rahul

On 8/22/14, 2:17 PM, "Shilen Patel" 
<>
 wrote:

>grouper_attributes_v is supposed to be dropped permanently so I don't
>think that's the issue.  Can you try running:
>gsh.sh -registry -deep ?  That should create another sql file that you can
>try running.
>
>
>Thanks!
>
>-- Shilen
>
>On 8/22/14 2:11 PM, "Rahul Doshi" 
><>
> wrote:
>
>>Sorry email accidentally got sent before I could finish typing.  Here is
>>the output of step 6 ./gsh -registry -check
>>
>>Are you sure you want to schemaexport all tables
>>(dropThenCreate=F,writeAndRunScript=F) in db user 'grouper', db url
>>'jdbc:mysql://xxxxxxxx/grouper'? (y|n):
>>y
>>Continuing...
>>NOTE: database table/object structure (ddl) is up to date
>>
>>I reran the sql file generated earlier and got error below.  I did a grep
>>of grouper_attributes_v on the SQL file and saw a drop view of
>>grouper_attributes_v but no create.  Could that be causing of the other
>>views not getting created?
>>
>>Error running script:
>>/opt/grouper/grouper.apiBinary-2.2.0/ddlScripts/grouperDdl_20140820_11_01
>>_
>>0
>>8_158.sql, com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Unknown
>>table 'grouper_attributes_v'
>>      at org.apache.tools.ant.taskdefs.SQLExec.execute(SQLExec.java:463)
>>      at 
>>edu.internet2.middleware.grouper.ddl.GrouperDdlUtils.sqlRun(GrouperDdlUti
>>l
>>s
>>.java:956)
>>      at 
>>edu.internet2.middleware.grouper.ddl.GrouperDdlUtils.sqlRun(GrouperDdlUti
>>l
>>s
>>.java:821)
>>      at 
>>edu.internet2.middleware.grouper.registry.RegistryInitializeSchema.main(R
>>e
>>g
>>istryInitializeSchema.java:142)
>>      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>      at 
>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java
>>:
>>5
>>7)
>>      at 
>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI
>>m
>>p
>>l.java:43)
>>      at java.lang.reflect.Method.invoke(Method.java:622)
>>      at 
>>edu.internet2.middleware.grouper.app.gsh.GrouperShell.handleSpecialCase(G
>>r
>>o
>>uperShell.java:204)
>>      at 
>>edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.j
>>a
>>v
>>a:144)
>>      at 
>>edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(Grouper
>>S
>>h
>>ellWrapper.java:31)
>>Caused by: com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Unknown
>>table 'grouper_attributes_v'
>>      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:936)
>>      at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985)
>>      at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631)
>>      at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723)
>>      at com.mysql.jdbc.Connection.execSQL(Connection.java:3277)
>>      at com.mysql.jdbc.Connection.execSQL(Connection.java:3206)
>>      at com.mysql.jdbc.Statement.execute(Statement.java:727)
>>      at org.apache.tools.ant.taskdefs.SQLExec.execSQL(SQLExec.java:565)
>>      at 
>> org.apache.tools.ant.taskdefs.SQLExec.runStatements(SQLExec.java:535)
>>      at 
>>org.apache.tools.ant.taskdefs.SQLExec$Transaction.runTransaction(SQLExec.
>>j
>>a
>>va:776)
>>      at 
>>org.apache.tools.ant.taskdefs.SQLExec$Transaction.access$000(SQLExec.java
>>:
>>7
>>06)
>>      at org.apache.tools.ant.taskdefs.SQLExec.execute(SQLExec.java:449)
>>      ... 10 more
>>
>>
>>Thanks,
>>Rahul
>>
>>
>>On 8/22/14, 2:06 PM, "Rahul Doshi" 
>><>
>> wrote:
>>
>>>Ok, so I tried step 6 again and got
>>>
>>>
>>>
>>>
>>>
>>>On 8/22/14, 2:01 PM, "Shilen Patel" 
>>><>
>>> wrote:
>>>
>>>>OK if one of the sql statements in the file failed during step 7, that
>>>>should have been printed out.  And if one statement fails, it does not
>>>>process anything after that, so it is also possible that there was a
>>>>failure before the create views.  Do you happen to still have the
>>>>output
>>>>of step 7?  Did it include the line "Script was executed successfully"?
>>>>
>>>>You could try rerunning steps 6 and 7 again.
>>>>
>>>>Thanks!
>>>>
>>>>-- Shilen
>>>>
>>>>On 8/22/14 1:51 PM, "Rahul Doshi" 
>>>><>
>>>> wrote:
>>>>
>>>>>I just did a grep on the sql file.  Drop and create view statements
>>>>>are
>>>>>there in the sql file.  So it looks like create view fails for some
>>>>>reason
>>>>>in our environment. No errors are logged in the grouper_error.log file
>>>>>and
>>>>>gsh loads up just fine after the upgrade.
>>>>>
>>>>>
>>>>>Thanks,
>>>>>Rahul
>>>>>
>>>>>On 8/22/14, 1:41 PM, "Shilen Patel" 
>>>>><>
>>>>> wrote:
>>>>>
>>>>>>Did the sql script include the statements to create the views?  The
>>>>>>sql
>>>>>>script should have started off by dropping all the views, then
>>>>>>dropping
>>>>>>constraints, then actually doing that part of the upgrade, then
>>>>>>adding
>>>>>>back the constraints, and finally adding back the views.  This is the
>>>>>>sql
>>>>>>script referenced in steps 6 and 7 of the upgrade instructions.
>>>>>>
>>>>>>Thanks!
>>>>>>
>>>>>>-- Shilen 
>>>>>>
>>>>>>On 8/22/14 1:27 PM, "Rahul Doshi" 
>>>>>><>
>>>>>> wrote:
>>>>>>
>>>>>>>Hi Shilen,
>>>>>>>
>>>>>>>When I upgraded our production database running grouper 2.1.4 in the
>>>>>>>dev
>>>>>>>environment to grouper 2.2.0 even thought upgrade script completed
>>>>>>>successfully none of the views starting with grouper_attr_asn_* and
>>>>>>>grouper_aval_asn_* got created.  I also ran
>>>>>>>postGrouper2_2Upgrade.gsh
>>>>>>>as
>>>>>>>part of upgrade.  Is it some kind of bug in the upgrade script?
>>>>>>>
>>>>>>>Thanks,
>>>>>>>Rahul
>>>>>>>
>>>>>>>On 8/22/14, 9:35 AM, "Shilen Patel" 
>>>>>>><>
>>>>>>> wrote:
>>>>>>>
>>>>>>>>The upgrade should have migrated the legacy attributes to the
>>>>>>>>attribute
>>>>>>>>framework and they should still be visible in the admin UI (not the
>>>>>>>>new
>>>>>>>>UI).
>>>>>>>>
>>>>>>>>Did you run the postGrouper2_2Upgrade.gsh script as part of the
>>>>>>>>upgrade?
>>>>>>>>If so, do you have the output from that?  If you query the view
>>>>>>>>GROUPER_AVAL_ASN_ASN_GROUP_V, do you see your legacy attributes
>>>>>>>>there?
>>>>>>>>
>>>>>>>>Thanks!
>>>>>>>>
>>>>>>>>-- Shilen
>>>>>>>>
>>>>>>>>On 8/22/14 8:53 AM, "GOOD Richard" 
>>>>>>>><>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>>Hi all,
>>>>>>>>>
>>>>>>>>>we've just started the process of upgrading our old Grouper 1.5.3
>>>>>>>>>instances to Grouper 2.2.
>>>>>>>>>
>>>>>>>>>Have managed (I think) to do an upgrade straight from 1.5.3 to 2.2
>>>>>>>>>on
>>>>>>>>>our
>>>>>>>>>DEV system.
>>>>>>>>>
>>>>>>>>>We're also using Java 1.8 and Tomcat 8 and so far all seems to be
>>>>>>>>>well
>>>>>>>>>(after a few tweaks which from the mailing list also have to be
>>>>>>>>>done
>>>>>>>>>for
>>>>>>>>>Tomcat 7). We're in the process of setting up PSP to provision
>>>>>>>>>Open
>>>>>>>>>LDAP,
>>>>>>>>>so once we have all the upgrade done and dusted I'll post back to
>>>>>>>>>the
>>>>>>>>>list with any observations and tweaks we had to make to get things
>>>>>>>>>to
>>>>>>>>>work.
>>>>>>>>>
>>>>>>>>>I have a question though regarding the migration of old types. We
>>>>>>>>>had
>>>>>>>>>a
>>>>>>>>>custom group type which we stored a gid value in, and a grouper
>>>>>>>>>hook
>>>>>>>>>which adds the custom group and then sets the gid value.
>>>>>>>>>
>>>>>>>>>Post upgrade, I can see all the values in the
>>>>>>>>>grouper_attributes_legacy
>>>>>>>>>table.
>>>>>>>>>
>>>>>>>>>However I'm not entirely sure what to do at this point. Do I need
>>>>>>>>>to
>>>>>>>>>now
>>>>>>>>>create a new attribute, assign to all groups and port the legacy
>>>>>>>>>values
>>>>>>>>>over? Or should I be able to query the legacy attributes still?
>>>>>>>>>They
>>>>>>>>>don't show up in the UI, and I don't appear to be able to get at
>>>>>>>>>them
>>>>>>>>>using Grouper Shell, but it's entirely likely that I'm missing
>>>>>>>>>something.
>>>>>>>>>
>>>>>>>>>I had a look at
>>>>>>>>>https://spaces.internet2.edu/display/Grouper/Legacy+attribute+migr
>>>>>>>>>a
>>>>>>>>>t
>>>>>>>>>i
>>>>>>>>>o
>>>>>>>>>n
>>>>>>>>>which pointed me to the right place in the database so I can see I
>>>>>>>>>haven't lost anything.
>>>>>>>>>
>>>>>>>>>Any pointers gratefully received!
>>>>>>>>>
>>>>>>>>>Cheers,
>>>>>>>>>
>>>>>>>>>Richard
>>>>>>>>>
>>>>>>>>>Richard Good
>>>>>>>>>Senior Analyst/Team Leader
>>>>>>>>>IS Applications Development ISG team
>>>>>>>>>Tel: (0131) 650 6628
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>-- 
>>>>>>>>>The University of Edinburgh is a charitable body, registered in
>>>>>>>>>Scotland, with registration number SC005336.
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>