Grouper Users - Open Discussion List

["Hyzer, Chris" <>]

John Gasper found an issue with the grouperInstaller which is now fixed.  Please download the installer and try again.

 

https://bugs.internet2.edu/jira/browse/GRP-1628

 

Thanks

Chris

 

 

 

Do you want to install grouper rabbitMQ messaging (t|f)? [f]: t

Downloading from URL: https://software.internet2.edu/grouper/release/2.3.0/grouper.rabbitMq-2.3.0.tar.gz to file: /tmp/grouperInstaller/tarballs/grouper.rabbitMq-2.3.0.tar.gz

Unzipping: /tmp/grouperInstaller/tarballs/grouper.rabbitMq-2.3.0.tar.gz

Expanding: /tmp/grouperInstaller/tarballs/grouper.rabbitMq-2.3.0.tar to /tmp/grouperInstaller/grouper.rabbitMq-2.3.0

Where do you want the Grouper RabbitMQ messaging connector installed? /tmp/grouperInstaller/grouper.apiBinary-2.3.0

Copying /tmp/grouperInstaller/grouper.rabbitMq-2.3.0/lib/amqp-client-4.0.2.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/amqp-client-4.0.2.jar

Skipping file that exists in destination: /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/slf4j-api-1.6.1.jar

Copying /tmp/grouperInstaller/grouper.rabbitMq-2.3.0/lib/grouperRabbitMq.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/grouperRabbitMq.jar

Skipping file that exists in destination: /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/slf4j-log4j12.jar

##################################

 

Configure your grouper.client.properties based on this file /tmp/grouperInstaller/grouper.rabbitMq-2.3.0/grouper.client.rabbitMq.example.properties

 

##################################

 

Do you want to install grouper AWS SQS messaging (t|f)? [f]: t

Downloading from URL: https://software.internet2.edu/grouper/release/2.3.0/grouper.aws-2.3.0.tar.gz to file: /tmp/grouperInstaller/tarballs/grouper.aws-2.3.0.tar.gz

Unzipping: /tmp/grouperInstaller/tarballs/grouper.aws-2.3.0.tar.gz

Expanding: /tmp/grouperInstaller/tarballs/grouper.aws-2.3.0.tar to /tmp/grouperInstaller/grouper.aws-2.3.0

Where do you want the Grouper AWS SQS messaging connector installed? /tmp/grouperInstaller/grouper.apiBinary-2.3.0

Copying /tmp/grouperInstaller/grouper.aws-2.3.0/lib/aws-java-sdk-bundle-1.11.155.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/aws-java-sdk-bundle-1.11.155.jar

Skipping file that exists in destination: /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/slf4j-api-1.6.1.jar

Copying /tmp/grouperInstaller/grouper.aws-2.3.0/lib/grouperSQSMessaging.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/grouperSQSMessaging.jar

Skipping file that exists in destination: /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/slf4j-log4j12.jar

##################################

 

Configure your grouper.client.properties based on this file /tmp/grouperInstaller/grouper.aws-2.3.0/grouper.client.aws.example.properties

 

##################################

 

Do you want to install grouper activeMq messaging (t|f)? [f]: t

Downloading from URL: https://software.internet2.edu/grouper/release/2.3.0/grouper.activeMq-2.3.0.tar.gz to file: /tmp/grouperInstaller/tarballs/grouper.activeMq-2.3.0.tar.gz

Unzipping: /tmp/grouperInstaller/tarballs/grouper.activeMq-2.3.0.tar.gz

Expanding: /tmp/grouperInstaller/tarballs/grouper.activeMq-2.3.0.tar to /tmp/grouperInstaller/grouper.activeMq-2.3.0

Where do you want the Grouper ActiveMq messaging connector installed? /tmp/grouperInstaller/grouper.apiBinary-2.3.0

Copying /tmp/grouperInstaller/grouper.activeMq-2.3.0/lib/grouperActiveMQMessaging.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/grouperActiveMQMessaging.jar

Copying /tmp/grouperInstaller/grouper.activeMq-2.3.0/lib/activemq-all-5.15.0.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/activemq-all-5.15.0.jar

Skipping file that exists in destination: /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/slf4j-api-1.6.1.jar

Copying /tmp/grouperInstaller/grouper.activeMq-2.3.0/lib/qpid-jms-client-0.11.1.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/qpid-jms-client-0.11.1.jar

Skipping file that exists in destination: /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/slf4j-log4j12.jar

Copying /tmp/grouperInstaller/grouper.activeMq-2.3.0/lib/geronimo-jms_1.1_spec-1.1.1.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/geronimo-jms_1.1_spec-1.1.1.jar

Copying /tmp/grouperInstaller/grouper.activeMq-2.3.0/lib/netty-all-4.0.41.Final.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/netty-all-4.0.41.Final.jar

Copying /tmp/grouperInstaller/grouper.activeMq-2.3.0/lib/proton-j-0.14.0.jar to /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/proton-j-0.14.0.jar

##################################

 

Configure your grouper.client.properties based on this file /tmp/grouperInstaller/grouper.activeMq-2.3.0/grouper.client.activeMq.example.properties

 

##################################

 

 

##################################

 

 

Installation success!

 

Run the installer's 'admin' function to get information and manage about your installation (db, tomcat, logs, etc)

 

##################################

 

[mchyzer@i2midev6 grouperInstaller]$ ls

apache-tomcat-8.5.12    grouper.apiBinary-2.3.0  grouperInstaller.jar    hsqlDbErr.log  subjects.sql

grouper.activeMq-2.3.0  grouper.aws-2.3.0        grouper.rabbitMq-2.3.0  hsqlDbOut.log  tarballs

[mchyzer@i2midev6 grouperInstaller]$ mkdir temp

[mchyzer@i2midev6 grouperInstaller]$ cd temp

[mchyzer@i2midev6 temp]$ jar xvf /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/grouperActiveMQMessaging.jar

  created: META-INF/

inflated: META-INF/MANIFEST.MF

  created: edu/

  created: edu/internet2/

  created: edu/internet2/middleware/

  created: edu/internet2/middleware/grouperMessagingActiveMQ/

inflated: edu/internet2/middleware/grouperMessagingActiveMQ/GrouperMessageActiveMQ.class

inflated: edu/internet2/middleware/grouperMessagingActiveMQ/GrouperMessageActiveMQ.java

inflated: edu/internet2/middleware/grouperMessagingActiveMQ/GrouperMessagingActiveMQSystem$1.class

inflated: edu/internet2/middleware/grouperMessagingActiveMQ/GrouperMessagingActiveMQSystem$ActiveMQClientConnectionFactory.class

inflated: edu/internet2/middleware/grouperMessagingActiveMQ/GrouperMessagingActiveMQSystem.class

inflated: edu/internet2/middleware/grouperMessagingActiveMQ/GrouperMessagingActiveMQSystem.java

[mchyzer@i2midev6 temp]$ jar xvf /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/grouper

grouperActiveMQMessaging.jar  grouperClient.jar             grouperRabbitMq.jar           grouperSQSMessaging.jar

[mchyzer@i2midev6 temp]$ jar xvf /tmp/grouperInstaller/grouper.apiBinary-2.3.0/lib/grouper/grouperRabbitMq.jar

  created: META-INF/

inflated: META-INF/MANIFEST.MF

  created: edu/

  created: edu/internet2/

  created: edu/internet2/middleware/

  created: edu/internet2/middleware/grouperMessagingRabbitmq/

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessageRabbitmq.class

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessageRabbitmq.java

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem$1.class

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem$2.class

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem$RabbitMQConnectionFactory.class

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem.class

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem.java

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/MessageReceiveEventListener.class

inflated: edu/internet2/middleware/grouperMessagingRabbitmq/MessageReceiveEventListener.java

[mchyzer@i2midev6 temp]$

 

 

 

From: John Gasper [mailto:]
Sent: Monday, November 13, 2017 1:44 PM
To: Hyzer, Chris <>
Subject: Re: Installer mangles grouperRabbitMq.jar and others

 

Here’s a little more details. I’ve run the build with OpenJDK Zulu and Oracle JDK. The both produce the same inconsistent output:

 

sha1sum /opt/grouper/2.3.0/grouper.rabbitMq-2.3.0/lib/grouperRabbitMq.jar

7bbc04d3574f90b65002f389bcb98714f8938657  /opt/grouper/2.3.0/grouper.rabbitMq-2.3.0/lib/grouperRabbitMq.jar

 

sha1sum /opt/grouper/2.3.0/grouper.apiBinary-2.3.0/lib/grouper/grouperRabbitMq.jar

17c2ae0988cc4e643b0b11e836f1c9eaae4d3301  /opt/grouper/2.3.0/grouper.apiBinary-2.3.0/lib/grouper/grouperRabbitMq.jar

 

-- 

John Gasper
IAM Consultant
Unicon, Inc.
PGP/GPG Key: 0xbafee3ef

 

From: John Gasper <>
Date: Monday, November 13, 2017 at 9:32 AM
To: "Hyzer, Chris" <>
Subject: Installer mangles grouperRabbitMq.jar and others

 

Hi Chris,

 

I just wanted to get your take on something privately as I’m sure what I’m experience means. I’m updating my Docker automated builds, and my proposed TIER Grouper noVM one specifically, to include the messaging components. I’m finding that the grouperRabbitMq.jar, etc. gets corrupted along the way. Here are two examples:

 

> diff /opt/grouper/2.3.0/grouper.rabbitMq-2.3.0/lib/grouperRabbitMq.jar /opt/grouper/2.3.0/grouper.apiBinary-2.3.0/lib/grouper/grouperRabbitMq.jar

Binary files /opt/grouper/2.3.0/grouper.rabbitMq-2.3.0/lib/grouperRabbitMq.jar and /opt/grouper/2.3.0/grouper.apiBinary-2.3.0/lib/grouper/grouperRabbitMq.jar differ

 

> grouper.rabbitMq-2.3.0]# diff /opt/grouper/2.3.0/grouper.activeMq-2.3.0/lib/grouperActiveMQMessaging.jar /opt/grouper/2.3.0/grouper.apiBinary-2.3.0/lib/grouper/grouperActiveMQMessaging.jar

Binary files /opt/grouper/2.3.0/grouper.activeMq-2.3.0/lib/grouperActiveMQMessaging.jar and /opt/grouper/2.3.0/grouper.apiBinary-2.3.0/lib/grouper/grouperActiveMQMessaging.jar differ

 

I’m using the grouperInstaller to do the install and I ran the previous command immediately after the process finished. The installer downloads and extracts them just fine. If I “jar tf” the unGzipped files the output expectedly:

 

> /opt/openjdk7/bin/jar tf lib/grouperRabbitMq.jar

META-INF/

META-INF/MANIFEST.MF

edu/

edu/internet2/

edu/internet2/middleware/

edu/internet2/middleware/grouperMessagingRabbitmq/

edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessageRabbitmq.class

edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessageRabbitmq.java

edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem$1.class

edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem$2.class

edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem$RabbitMQConnectionFactory.class

edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem.class

edu/internet2/middleware/grouperMessagingRabbitmq/GrouperMessagingRabbitmqSystem.java

edu/internet2/middleware/grouperMessagingRabbitmq/MessageReceiveEventListener.class

edu/internet2/middleware/grouperMessagingRabbitmq/MessageReceiveEventListener.java

 

If I do the same for the file that have been moved to the grouper.apiBinary/lib/grouper directory, I get:

 

> /opt/openjdk7/bin/jar tf grouperRabbitMq.jar

java.util.zip.ZipException: invalid CEN header (bad signature)

        at java.util.zip.ZipFile.open(Native Method)

        at java.util.zip.ZipFile.<init>(ZipFile.java:219)

        at java.util.zip.ZipFile.<init>(ZipFile.java:149)

        at java.util.zip.ZipFile.<init>(ZipFile.java:120)

        at sun.tools.jar.Main.list(Main.java:1115)

        at sun.tools.jar.Main.run(Main.java:293)

        at sun.tools.jar.Main.main(Main.java:1288)

 

Any idea why the installer is having issues copying the files over? My no frills installer properties file is attached.

 

 

Thanks,

John

 

-- 

John Gasper
IAM Consultant
Unicon, Inc.
PGP/GPG Key: 0xbafee3ef