Grouper Users - Open Discussion List

[Wallaert-Taquet Brigitte <>]

Le 16/12/2015 15:32, Chris Hyzer a écrit :

Does this exist?

 

/home/rester/Grouper22-pg/grouper.ui-2.2.1/build/grouper22-ui/WEB-INF/bin/gsh

No

 

Do you run the webapp from there or is it in tomcat/webapps?

From the tomcat/webapps :
/home/rester/Grouper22-pg/apache-tomcat-7.0.62/webapps

Thanks.
Brigitte

 

Thanks,

Chris

 

 

 

From: Wallaert-Taquet Brigitte []
Sent: Wednesday, December 16, 2015 5:20 AM
To: Chris Hyzer; Baron Fujimoto; Grouper Users
Subject: Re: [grouper-users] Upgrade errors 2.2.1 -> 2.2.2

 

Hello,

I upgrade my installation grouper2.2.1 with API successfully but I can't for UI. I have the same message that Baron Fujimoto and sorry but I don't understand your response Chris : "You need to pick the webapp dir which is the exploded warfile"

I wonder if it'snt because I use "grouper22-ui"  instead "grouper" for my webapp ?

So, I made several tests until the last that is almost ok but finally end with errors :

Here is my trace :

Where is the grouper UI installed? /home/rester/Grouper22-pg/grouper.ui-2.2.1
Cant find Grouper UI properties files or libs, looked in the directory, /classes/ , /conf/ , /WEB-INF/classes/ , /lib/ , /WEB-INF/lib/ , /lib/grouper/ , /dist/lib/
Where is the grouper UI installed? /home/rester/Grouper22-pg/grouper.ui-2.2.1/build/grouper22-ui
Upgrading to grouper UI version: 2.2.2
Do you want to fix the patch index file (download all patches and see if they are installed?) (recommended) (t|f)? [t]:
Downloading from URL: http://software.internet2.edu/grouper/release/2.2.1/patches/grouper_v2_2_1_ui_patch_0.tar.gz to file: /home/rester/Grouper22-pg/tempinstallUI/grouper_v2_2_1_ui_patch_0.tar.gz
Unzipping: /home/rester/Grouper22-pg/tempinstallUI/grouper_v2_2_1_ui_patch_0.tar.gz
Expanding: /home/rester/Grouper22-pg/tempinstallUI/grouper_v2_2_1_ui_patch_0.tar
[...]
BUILD SUCCESSFUL
Total time: 18 seconds


End building UI
##################################

What is the location of your tomcat server.xml for the UI?  Note, if you dont use tomcat just leave it blank or type 'blank':
/home/rester/Grouper22-pg/apache-tomcat-7.0.62/conf/server.xml
End download and build grouper packages


##################################
Exception in thread "main" java.lang.RuntimeException: Cant find gsh: /home/rester/Grouper22-pg/grouper.ui-2.2.1/build/grouper22-ui/
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.gshCommand(GrouperInstaller.java:7725)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.upgradeApiPreRevertPatch(GrouperInstaller.java:3048)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.upgradeUi(GrouperInstaller.java:2647)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.access$1300(GrouperInstaller.java:78)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller$AppToUpgrade$1.upgradeApp(GrouperInstaller.java:4212)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.mainUpgradeLogic(GrouperInstaller.java:2557)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.access$400(GrouperInstaller.java:78)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller$GrouperInstallerMainFunction$2.logic(GrouperInstaller.java:981)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.mainLogic(GrouperInstaller.java:1032)
    at edu.internet2.middleware.grouperInstaller.GrouperInstaller.main(GrouperInstaller.java:303)

So, I have the grouperPatchStatus.properties in /home/rester/Grouper22-pg/Grouper-UI/build/grouper22-ui/WEB-INF :
more grouperPatchStatus.properties :
# added by grouper-installer
grouperInstallerLastFixedIndexFile.date = 2015/12/16 10:40:15

or I have the grouperPatchStatus.properties in /home/rester/Grouper22-pg/Grouper-API with :
more grouperPatchStatus.properties

# added by grouper-installer
grouperInstallerLastFixedIndexFile.date = 2015/12/15 14:07:29

# added by grouper-installer
grouper_v2_2_2_api_patch_0.date = 2015/12/15 14:22:16

# added by grouper-installer
grouper_v2_2_2_api_patch_0.state = applied
etc...

I would like to have the grouperPatchStatus.properties in /home/rester/Grouper22-pg/Grouper-UI instead... but how ?

More infos :

find /home/rester/Grouper22-pg/grouper.ui-2.2.1 -name lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/java/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/dist/grouper22-ui/WEB-INF/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/build/grouper22-ui/WEB-INF/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/contrib/yale-cas-auth/java/lib
/home/rester/Grouper22-pg/grouper.ui-2.2.1/contrib/penn-auth/java/lib

Thanks for any help.
Brigitte

Le 03/11/2015 20:30, Chris Hyzer a écrit :

You need to pick the webapp dir which is the exploded warfile

Thanks

Chris

-----Original Message-----

From: Baron Fujimoto [] 

Sent: Tuesday, November 03, 2015 2:30 PM

To: Chris Hyzer; Grouper Users

Subject: Re: [grouper-users] Upgrade errors 2.2.1 -> 2.2.2

Same error when I try to upgrade the WS. These are the directories

I use when I build the components manually.

=====

Do you want to 'install' a new installation of grouper, 'upgrade' an existing installation,

  'patch' an existing installation, or 'createPatch' for Grouper developers

  (enter: 'install', 'upgrade', 'patch', 'createPatch' or blank for the default) [install]: patch

Enter in a Grouper temp directory to download tarballs (note: better if no spaces or special chars) [/home/grouper/grouper/installer-archive]:

What do you want to patch?  api, ui, ws, or psp? [api]: ws

Where is the grouper WS installed? /home/grouper/grouper/grouper-ws/grouper-ws

Cant find Grouper WS properties files or libs, looked in the directory, /classes/ , /conf/ , /WEB-INF/classes/ , /lib/ , /WEB-INF/lib/ , /lib/grouper/ , /dist/lib/

=====

-baron

On Mon, Nov 02, 2015 at 02:46:28PM -1000, Baron Fujimoto wrote:

I finally got our change logs copied over, and the grouperInstaller reports

a successful upgrade for the api: Grouper is upgraded from 2.2.1 to 2.2.2

When I try to upgrade the ui next though, I run into the following:

=====

[...]

Where is the grouper UI installed? /home/grouper/grouper/grouper.ui-2.2.1

Cant find Grouper UI properties files or libs, looked in the directory, /classes/ , /conf/ , /WEB-INF/classes/ , /lib/ , /WEB-INF/lib/ , /lib/grouper/ , /dist/lib/

=====

As far as I know that is the correct location where the UI is installed.

I don't know what it's looking for specifically, but I have

$ find /home/grouper/grouper/grouper.ui-2.2.1 -name lib

/home/grouper/grouper/grouper.ui-2.2.1/dist/grouper/WEB-INF/lib

/home/grouper/grouper/grouper.ui-2.2.1/contrib/penn-auth/java/lib

/home/grouper/grouper/grouper.ui-2.2.1/contrib/yale-cas-auth/java/lib

/home/grouper/grouper/grouper.ui-2.2.1/build/grouper/WEB-INF/lib

/home/grouper/grouper/grouper.ui-2.2.1/java/lib

and

find /home/grouper/grouper/grouper.ui-2.2.1 -name "*.properties"

[...lots of results under /webapp, /dist, /misc, /build, and /conf...]

FWIW, the grouperInstaller also complains:

Error: Java should be version 6 or 7 (1.6 or 1.7), but is detected as: 1.8.0_66

but I'm assuming this is not actually a problem?

Aloha,

-baron

On Thu, Oct 29, 2015 at 07:52:36PM +0000, Chris Hyzer wrote:

Let me know if you are able to complete the upgrade... I would run the loader even if you aren't provisioning...  I will see about updating the docs about it after discussing it at the next dev call and let you know how it does.

Thanks,

Chris

-----Original Message-----

From: Baron Fujimoto [] 

Sent: Thursday, October 29, 2015 3:42 PM

To: Chris Hyzer

Cc: Grouper Users

Subject: Re: [grouper-users] Upgrade errors 2.2.1 -> 2.2.2

On Thu, Oct 29, 2015 at 06:49:47PM +0000, Chris Hyzer wrote:

After patching 2.2.1, downloading, and unpacking the new

grouper.apiBinary-2.2.2, I accepted the recommendation to run a script

that copies change log temp records to the change log. This ran for hours,

and was still running when I left for the day.

When I returned this morning, I was greeted with the error below[*],

followed by the advisory that,

=====

You need to revert all patches to upgrade

################ Checking patch grouper_v2_2_1_api_patch_21

Patch: grouper_v2_2_1_api_patch_21: was applied on: 2015/08/10 13:41:24"

=====

I'm unsure what remedial steps are actually needed now. grouperInstaller

looks like it wants to resume from or retry grouper_v2_2_1_api_patch_21.

Should I just let it continue, or do I need to "revert *all* patches" as

displayed and start over?

Do you run the grouper loader which copies change log temp to change log continuously?  Were there a lot of records unprocessed in grouper change log temp table?  You need to run a grouper loader process for grouper to function correctly.  It is part of the standard upgrade to uninstall all 2.2.1 patches to get to 2.2.2.  So let it revert all the 2.2.1 patches, you can answer yes to each one or revert all at once.

Hmm, no we're not running a grouper loader. I wasn't aware of this

requirement. Did I miss it in the documentation somewhere? The wiki

page for Grouper Loader seems to describe it in terms of a provisioning

system, and not something needed for regular/ongoing operation. We've been

provisioning and maintaining all of our groups via the WS.

<https://spaces.internet2.edu/display/Grouper/Grouper+-+Loader>

Where is this maintenance aspect of the change logs described?

Is the amount of time being taken to copy the change logs reasonable? I

think our db goes down nightly for a backup. If the the copy change log

process can't complete before that happens, will it resume from a previous

partial completion, or does it need to start all over from the beginning?

I'm concerned about the possibility that may never complete given the

db's backup downtime constraint.

I don't know, how many records were there?  Yes, it is not one large transaction, it will make progress, and if you stop it and restart it will pickup from where it left off.  Do some record counts while it runs and see it making progress.

Are these the right tables?

select count(*) from grouper_change_log_entry;      ->  419750

select count(*) from grouper_change_log_entry_temp; -> 3988004

So, maybe yikes.

Could this also be the reason why we occasionally see audit log requests

time out? 

Aloha,

-baron

-- 

Baron Fujimoto  :: UH Information Technology Services

minutas cantorum, minutas balorum, minutas carboratum desendus pantorum

-- 

Baron Fujimoto  :: UH Information Technology Services

minutas cantorum, minutas balorum, minutas carboratum desendus pantorum

 

--


Brigitte WALLAERT TAQUET
Cheffe de projet GED Nuxeo
Experte Grouper d'Internet2

Université de Lille - Sciences et Technologies
| www.univ-lille1.fr
Service: CRI Bât. M4 - Bureau 34 59655 Villeneuve d'Ascq
Tél. +33 (0)3 20 33 71 65

--


Brigitte WALLAERT TAQUET
Cheffe de projet GED Nuxeo
Experte Grouper d'Internet2

Université de Lille - Sciences et Technologies
| www.univ-lille1.fr
Service: CRI Bât. M4 - Bureau 34 59655 Villeneuve d'Ascq
Tél. +33 (0)3 20 33 71 65