Grouper Users - Open Discussion List

["Redman, Chad" <>]

The immediate problem may be the build using source code from 2.3 but libraries from 2.4. The servlet api library was upgraded from 2.3 to 3.1 (so compatible with Tomcat 8), and it includes a few new abstract methods. In the grouper 2.4 code, those methods have been implemented, so you wouldn't have seen those errors.

 

But the bigger issue is probably going to be that the CAS contrib code is likely out of date. The struts code has been removed, so the web.xml settings won't be effective, and some URIs hardcoded in Java files will need to be adjusted.

 

I'm throwing together a quick cas demo server, and doing some quick tests to see what kind of shape 2.4 is in.

 

-Chad

 

 

From: [mailto:] On Behalf Of Ben Beecher
Sent: Monday, April 15, 2019 4:09 PM
To: Hyzer, Chris <>
Cc: Mailing List <>
Subject: Re: [grouper-users] upgrading to 2.4

 

Hi Chris,

I upgraded those modules again with the full patch set and it's working now. Thanks for your help.

After upgrading to Grouper 2.4 the CAS authentication is no longer working. I can only use Basic Auth to log in to Grouper 2.4. We have been using the Yale CAS Client (yale-cas-auth) following these instructions

https://spaces.at.internet2.edu/display/Grouper/Implementing+CAS+Authentication+for+Grouper

 

I double checked the updates to these files

/var/grouper/installGrouper2.3/grouper.ui-2.3.0/build.xml

/var/grouper/installGrouper2.3/grouper.ui-2.3.0/contrib/yale-cas-auth/build.properties

/var/grouper/installGrouper2.3/grouper.ui-2.3.0/webapp/WEB-INF/struts-config.xml

/var/grouper/installGrouper2.3/grouper.apiBinary-2.3.0/conf/sources.xml

 

Everything looks ok there, sources.xml was replaced by subject.properties. I am not sure if I need to rebuild the war file as per the instructions. When I try to rebuild I get some errors:

 

$ ant war

Buildfile: /var/grouper/installGrouper2.3/grouper.ui-2.3.0/build.xml

 

 

-compileGrouper:

    [mkdir] Created dir: /var/grouper/installGrouper2.3/grouper.ui-2.3.0/temp/jarBin

    [javac] /var/grouper/installGrouper2.3/grouper.ui-2.3.0/build.xml:452: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds

    [javac] Compiling 324 source files to /var/grouper/installGrouper2.3/grouper.ui-2.3.0/temp/jarBin

    [javac] warning: [options] bootstrap class path not set in conjunction with -source 1.5

    [javac] warning: [options] source value 1.5 is obsolete and will be removed in a future release

    [javac] warning: [options] target value 1.5 is obsolete and will be removed in a future release

    [javac] warning: [options] To suppress warnings about obsolete options, use -Xlint:-options.

    [javac] /var/grouper/installGrouper2.3/grouper.ui-2.3.0/java/src/edu/internet2/middleware/grouper/j2ee/GenericServletResponseWrapper.java:35: error: GenericServletResponseWrapper is not abstract and does not override abstract method getHeaderNames() in HttpServletResponse

    [javac] public class GenericServletResponseWrapper extends ServletResponseWrapper implements HttpServletResponse {

    [javac]        ^

    [javac] /var/grouper/installGrouper2.3/grouper.ui-2.3.0/java/src/edu/internet2/middleware/grouper/ui/CaptureServletOutputStream.java:47: error: CaptureServletOutputStream is not abstract and does not override abstract method setWriteListener(WriteListener) in ServletOutputStream

    [javac] public class CaptureServletOutputStream extends ServletOutputStream {

    [javac]        ^

    [javac] Note: Some input files use or override a deprecated API.

    [javac] Note: Recompile with -Xlint:deprecation for details.

    [javac] Note: Some input files use unchecked or unsafe operations.

    [javac] Note: Recompile with -Xlint:unchecked for details.

    [javac] 2 errors

    [javac] 4 warnings

 

 

Any suggestions?

Ben

 

On Wed, Apr 3, 2019 at 9:00 AM Hyzer, Chris <> wrote:

Are you sure you pointed the upgrader to the right spot?  I think the WS might live somewhere else?  look in apache config and see where it is linking to

 

From: Ben Beecher <>
Sent: Tuesday, April 02, 2019 4:05 PM
To: Hyzer, Chris <>
Cc: Mailing List <>; Ben Beecher <>
Subject: Re: [grouper-users] upgrading to 2.4

 

Hi Chris,

I was able to get past that error by copying the old patches to /var/grouper/installGrouper2.3/tarballs/patches/

I have another question for you.

I used the Grouper upgrader to upgrade the api and ui modules. While upgrading the ws it reverted all patches and then it got this error:

 

> Upgrading WS jars

> Exception in thread "main" java.lang.RuntimeException: Why does jar directory not exist?

> /var/grouper/installGrouper2.3/tarballs/grouper.ws-2.4.0/grouper-ws/build/dist/grouper-ws/WEB-INF/lib

 

I created the last two subdirectories manually (WEB-INF/lib) and then I ran the upgrader again. I got a different error this time:

 

Upgrading WS jars

Upgraded 0 jar files from: /var/grouper/installGrouper2.3/tarballs/grouper.ws-2.4.0/grouper-ws/build/dist/grouper-ws/WEB-INF/lib

  to: /var/grouper/installGrouper2.3/grouper.ws-2.3.0/grouper-ws/build/dist/grouper-ws/WEB-INF/lib

 

##################################

Upgrading WS files

Upgrading files from: /var/grouper/installGrouper2.3/tarballs/grouper.ws-2.4.0/grouper-ws/build/dist/grouper-ws/

  to: /var/grouper/installGrouper2.3/grouper.ws-2.3.0/grouper-ws/build/dist/grouper-ws/

  ignoring paths: WEB-INF/bin/gsh.sh, WEB-INF/bin/gsh.bat, WEB-INF/lib, WEB-INF/bin/gsh, WEB-INF/web.xml, WEB-INF/classes

Compared 0 files and found 0 adds and 0 updates

Backing up: /var/grouper/installGrouper2.3/grouper.ws-2.3.0/grouper-ws/build/dist/grouper-ws/WEB-INF/bin/gsh.bat to: /var/grouper/installGrouper2.3/tarballs/bak_WS_2019_03_26_21_06_36_798/WEB-INF/bin/gsh.bat

Copying new file: /var/grouper/installGrouper2.3/tarballs/grouper.ws-2.4.0/grouper-ws/build/dist/grouper-ws/WEB-INF/bin/gsh.bat to: /var/grouper/installGrouper2.3/grouper.ws-2.3.0/grouper-ws/build/dist/grouper-ws/WEB-INF/bin/gsh.bat

Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: Source '/var/grouper/installGrouper2.3/tarballs/grouper.ws-2.4.0/grouper-ws/build/dist/grouper-ws/WEB-INF/bin/gsh.bat' does not exist

                at edu.internet2.middleware.grouperInstaller.util.GrouperInstallerUtils.copyFile(GrouperInstallerUtils.java:10550)

                at edu.internet2.middleware.grouperInstaller.GrouperInstaller.backupAndCopyFile(GrouperInstaller.java:6168)

        at edu.internet2.middleware.grouperInstaller.GrouperInstaller.upgradeWs(GrouperInstaller.java:13434)

        at edu.internet2.middleware.grouperInstaller.GrouperInstaller.access$5800(GrouperInstaller.java:84)

                at edu.internet2.middleware.grouperInstaller.GrouperInstaller$AppToUpgrade$4.upgradeApp(GrouperInstaller.java:6900)

                at edu.internet2.middleware.grouperInstaller.GrouperInstaller.mainUpgradeLogic(GrouperInstaller.java:4720)

        at edu.internet2.middleware.grouperInstaller.GrouperInstaller.access$600(GrouperInstaller.java:84)

        at edu.internet2.middleware.grouperInstaller.GrouperInstaller$GrouperInstallerMainFunction$3.logic(GrouperInstaller.java:1516)

                at edu.internet2.middleware.grouperInstaller.GrouperInstaller.mainLogic(GrouperInstaller.java:1728)

                at edu.internet2.middleware.grouperInstaller.GrouperInstaller.main(GrouperInstaller.java:561)

Caused by: java.io.FileNotFoundException: Source '/var/grouper/installGrouper2.3/tarballs/grouper.ws-2.4.0/grouper-ws/build/dist/grouper-ws/WEB-INF/bin/gsh.bat' does not exist

        at edu.internet2.middleware.grouperInstaller.util.GrouperInstallerUtils.copyFile(GrouperInstallerUtils.java:10530)

                ... 9 more

 

 

I see the new version of gsh.bat in the ui directory so perhaps I don't need to update the gsh.bat in the ws directory.

 

$ ls -l /var/grouper/installGrouper2.3/grouper.ui-2.3.0/dist/grouper/WEB-INF/bin/gsh.bat

-rwxr-xr-x. 1 idmserv idmserv 4174 Mar 26 20:46 /var/grouper/installGrouper2.3/grouper.ui-2.3.0/dist/grouper/WEB-INF/bin/gsh.bat

Ben

 

On Wed, Mar 20, 2019 at 9:39 AM Hyzer, Chris <> wrote:

Ben, I think you need to download the 2.4 ALL zip, which you did, but you also need the 2.3 ALL zip, can you download that to so the file not found goes away and see if it works?

 

From: <> On Behalf Of Hyzer, Chris
Sent: Tuesday, March 19, 2019 11:35 PM
To: Ben Beecher <>; Mailing List <>
Subject: RE: [grouper-users] upgrading to 2.4

 

Ugh, maybe copy the dir you are upgrading to an internet machine, upgrade, and copy back… sorry, I entered a jira…

 

Thanks

Chris

 

From: <> On Behalf Of Ben Beecher
Sent: Tuesday, March 19, 2019 4:00 PM
To: Mailing List <>
Subject: [grouper-users] upgrading to 2.4

 

(1) I am trying to upgrade from version 2.3 to version 2.4. The Grouper upgrader wants to upgrade in place (not into a new directory) so do I need to rename the directory after the upgrade is complete? The current directory name is

/var/grouper/installGrouper2.3

 

and I think the new name should be

/var/grouper/installGrouper2.4

 

 

(2) I get an error during the upgrade process. My server is on a secure network so it can't download patch files from the internet. I downloaded the tar file which contains all patches

http://software.internet2.edu/grouper/release/2.4.0/grouper.all-2.4.0.tar.gz

 

I uncompressed and extracted the contents to this directory

/var/grouper/grouper.all-2.4.0

 

I created a properties file that points to the new directory

 

$ cat /var/grouper/installGrouper2.3/grouper.installer.properties 

download.server.url = "/var/grouper/grouper.all-2.4.0

 

# default version to install

grouper.version = 2.4.0

 

I ran the installer with the "upgrade" option but it gets an error when it tries to access one of the 2.3 patch files. It's looking for a 2.3 patch file in the 2.4 directory that was recently downloaded.

 

##################################

Gather upgrade information

 

Enter in a Grouper temp directory to download tarballs (note: better if no spaces or special chars) [/var/grouper/installGrouper2.3/tarballs]: /tmp/grouper/patches

You need to revert all patches to upgrade

 

################ Checking patch grouper_v2_3_0_api_patch_88

Patch: grouper_v2_3_0_api_patch_88: was applied on: 2018/02/08 16:05:53

 

Error connecting to URL: /var/grouper/grouper.all-2.4.0/release/2.3.0/patches/grouper_v2_3_0_api_patch_88.tar.gz

Exception in thread "main" java.lang.RuntimeException: Error connecting to URL: /var/grouper/grouper.all-2.4.0/release/2.3.0/patches/grouper_v2_3_0_api_patch_88.tar.gz,

 

I have attached the session log to this message.

 

Ben