Grouper Users - Open Discussion List

[Wallaert-Taquet Brigitte <>]

Hello,

I upgrade my installation grouper2.2.1 with API successfully but I can't for UI. I have the same message that Baron Fujimoto and sorry but I don't understand your response Chris : "You need to pick the webapp dir which is the exploded warfile"

I wonder if it'snt because I use "grouper22-ui"  instead "grouper" for my webapp ?

So, I made several tests until the last that is almost ok but finally end with errors :

Here is my trace :

Where is the grouper UI installed? /home/rester/Grouper22-pg/grouper.ui-2.2.1
Cant find Grouper UI properties files or libs, looked in the directory, /classes/ , /conf/ , /WEB-INF/classes/ , /lib/ , /WEB-INF/lib/ , /lib/grouper/ , /dist/lib/
Where is the grouper UI installed? /home/rester/Grouper22-pg/grouper.ui-2.2.1/build/grouper22-ui
Upgrading to grouper UI version: 2.2.2
Do you want to fix the patch index file (download all patches and see if they are installed?) (recommended) (t|f)? [t]:
Downloading from URL: http://software.internet2.edu/grouper/release/2.2.1/patches/grouper_v2_2_1_ui_patch_0.tar.gz to file: /home/rester/Grouper22-pg/tempinstallUI/grouper_v2_2_1_ui_patch_0.tar.gz
Unzipping: /home/rester/Grouper22-pg/tempinstallUI/grouper_v2_2_1_ui_patch_0.tar.gz
Expanding: /home/rester/Grouper22-pg/tempinstallUI/grouper_v2_2_1_ui_patch_0.tar
[...]
BUILD SUCCESSFUL
Total time: 18 seconds


End building UI
##################################

What is the location of your tomcat server.xml for the UI?  Note, if you dont use tomcat just leave it blank or type 'blank':
/home/rester/Grouper22-pg/apache-tomcat-7.0.62/conf/server.xml
End download and build grouper packages


##################################
Exception in thread "main" java.lang.RuntimeException: Cant find gsh: /home/rester/Grouper22-pg/grouper.ui-2.2.1/build/grouper22-ui/
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.gshCommand(GrouperInstaller.java:7725)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.upgradeApiPreRevertPatch(GrouperInstaller.java:3048)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.upgradeUi(GrouperInstaller.java:2647)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.access$1300(GrouperInstaller.java:78)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller$AppToUpgrade$1.upgradeApp(GrouperInstaller.java:4212)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.mainUpgradeLogic(GrouperInstaller.java:2557)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.access$400(GrouperInstaller.java:78)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller$GrouperInstallerMainFunction$2.logic(GrouperInstaller.java:981)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.mainLogic(GrouperInstaller.java:1032)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.main(GrouperInstaller.java:303)

So, I have the grouperPatchStatus.properties in /home/rester/Grouper22-pg/Grouper-UI/build/grouper22-ui/WEB-INF :
more grouperPatchStatus.properties :
# added by grouper-installer
grouperInstallerLastFixedIndexFile.date = 2015/12/16 10:40:15

or I have the grouperPatchStatus.properties in /home/rester/Grouper22-pg/Grouper-API with :
more grouperPatchStatus.properties

# added by grouper-installer
grouperInstallerLastFixedIndexFile.date = 2015/12/15 14:07:29

# added by grouper-installer
grouper_v2_2_2_api_patch_0.date = 2015/12/15 14:22:16

# added by grouper-installer
grouper_v2_2_2_api_patch_0.state = applied
etc...

I would like to have the grouperPatchStatus.properties in /home/rester/Grouper22-pg/Grouper-UI instead... but how ?

More infos :

find /home/rester/Grouper22-pg/grouper.ui-2.2.1 -name lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/java/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/dist/grouper22-ui/WEB-INF/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/build/grouper22-ui/WEB-INF/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/contrib/yale-cas-auth/java/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/contrib/penn-auth/java/lib

Thanks for any help.
Brigitte

Le 03/11/2015 20:30, Chris Hyzer a écrit :

You need to pick the webapp dir which is the exploded warfile

Thanks
Chris

-----Original Message-----
From: Baron Fujimoto [] 
Sent: Tuesday, November 03, 2015 2:30 PM
To: Chris Hyzer; Grouper Users
Subject: Re: [grouper-users] Upgrade errors 2.2.1 -> 2.2.2

Same error when I try to upgrade the WS. These are the directories
I use when I build the components manually.

=====
Do you want to 'install' a new installation of grouper, 'upgrade' an existing installation,
  'patch' an existing installation, or 'createPatch' for Grouper developers
  (enter: 'install', 'upgrade', 'patch', 'createPatch' or blank for the default) [install]: patch
Enter in a Grouper temp directory to download tarballs (note: better if no spaces or special chars) [/home/grouper/grouper/installer-archive]:
What do you want to patch?  api, ui, ws, or psp? [api]: ws
Where is the grouper WS installed? /home/grouper/grouper/grouper-ws/grouper-ws
Cant find Grouper WS properties files or libs, looked in the directory, /classes/ , /conf/ , /WEB-INF/classes/ , /lib/ , /WEB-INF/lib/ , /lib/grouper/ , /dist/lib/
=====

-baron
On Mon, Nov 02, 2015 at 02:46:28PM -1000, Baron Fujimoto wrote:

I finally got our change logs copied over, and the grouperInstaller reports
a successful upgrade for the api: Grouper is upgraded from 2.2.1 to 2.2.2

When I try to upgrade the ui next though, I run into the following:
=====
[...]
Where is the grouper UI installed? /home/grouper/grouper/grouper.ui-2.2.1
Cant find Grouper UI properties files or libs, looked in the directory, /classes/ , /conf/ , /WEB-INF/classes/ , /lib/ , /WEB-INF/lib/ , /lib/grouper/ , /dist/lib/
=====
As far as I know that is the correct location where the UI is installed.

I don't know what it's looking for specifically, but I have

$ find /home/grouper/grouper/grouper.ui-2.2.1 -name lib
/home/grouper/grouper/grouper.ui-2.2.1/dist/grouper/WEB-INF/lib
/home/grouper/grouper/grouper.ui-2.2.1/contrib/penn-auth/java/lib
/home/grouper/grouper/grouper.ui-2.2.1/contrib/yale-cas-auth/java/lib
/home/grouper/grouper/grouper.ui-2.2.1/build/grouper/WEB-INF/lib
/home/grouper/grouper/grouper.ui-2.2.1/java/lib

and

find /home/grouper/grouper/grouper.ui-2.2.1 -name "*.properties"
[...lots of results under /webapp, /dist, /misc, /build, and /conf...]

FWIW, the grouperInstaller also complains:

Error: Java should be version 6 or 7 (1.6 or 1.7), but is detected as: 1.8.0_66

but I'm assuming this is not actually a problem?

Aloha,
-baron

On Thu, Oct 29, 2015 at 07:52:36PM +0000, Chris Hyzer wrote:

Let me know if you are able to complete the upgrade... I would run the loader even if you aren't provisioning...  I will see about updating the docs about it after discussing it at the next dev call and let you know how it does.

Thanks,
Chris

-----Original Message-----
From: Baron Fujimoto [] 
Sent: Thursday, October 29, 2015 3:42 PM
To: Chris Hyzer
Cc: Grouper Users
Subject: Re: [grouper-users] Upgrade errors 2.2.1 -> 2.2.2

On Thu, Oct 29, 2015 at 06:49:47PM +0000, Chris Hyzer wrote:

After patching 2.2.1, downloading, and unpacking the new
grouper.apiBinary-2.2.2, I accepted the recommendation to run a script
that copies change log temp records to the change log. This ran for hours,
and was still running when I left for the day.

When I returned this morning, I was greeted with the error below[*],
followed by the advisory that,

=====
You need to revert all patches to upgrade

################ Checking patch grouper_v2_2_1_api_patch_21
Patch: grouper_v2_2_1_api_patch_21: was applied on: 2015/08/10 13:41:24"
=====

I'm unsure what remedial steps are actually needed now. grouperInstaller
looks like it wants to resume from or retry grouper_v2_2_1_api_patch_21.
Should I just let it continue, or do I need to "revert *all* patches" as
displayed and start over?

Do you run the grouper loader which copies change log temp to change log continuously?  Were there a lot of records unprocessed in grouper change log temp table?  You need to run a grouper loader process for grouper to function correctly.  It is part of the standard upgrade to uninstall all 2.2.1 patches to get to 2.2.2.  So let it revert all the 2.2.1 patches, you can answer yes to each one or revert all at once.

Hmm, no we're not running a grouper loader. I wasn't aware of this
requirement. Did I miss it in the documentation somewhere? The wiki
page for Grouper Loader seems to describe it in terms of a provisioning
system, and not something needed for regular/ongoing operation. We've been
provisioning and maintaining all of our groups via the WS.
<https://spaces.internet2.edu/display/Grouper/Grouper+-+Loader>

Where is this maintenance aspect of the change logs described?

Is the amount of time being taken to copy the change logs reasonable? I
think our db goes down nightly for a backup. If the the copy change log
process can't complete before that happens, will it resume from a previous
partial completion, or does it need to start all over from the beginning?
I'm concerned about the possibility that may never complete given the
db's backup downtime constraint.

I don't know, how many records were there?  Yes, it is not one large transaction, it will make progress, and if you stop it and restart it will pickup from where it left off.  Do some record counts while it runs and see it making progress.

Are these the right tables?

select count(*) from grouper_change_log_entry;      ->  419750
select count(*) from grouper_change_log_entry_temp; -> 3988004

So, maybe yikes.

Could this also be the reason why we occasionally see audit log requests
time out? 

Aloha,
-baron
-- 
Baron Fujimoto  :: UH Information Technology Services
minutas cantorum, minutas balorum, minutas carboratum desendus pantorum

-- 
Baron Fujimoto  :: UH Information Technology Services
minutas cantorum, minutas balorum, minutas carboratum desendus pantorum

--


Brigitte WALLAERT TAQUET
Cheffe de projet GED Nuxeo
Experte Grouper d'Internet2

Université de Lille - Sciences et Technologies
| www.univ-lille1.fr
Service: CRI Bât. M4 - Bureau 34 59655 Villeneuve d'Ascq
Tél. +33 (0)3 20 33 71 65