Grouper Users - Open Discussion List

[Shannon Roddy <>]

Hi Chris,

I tested today and wasn't able to personally duplicate the error that we
experienced last week during the install (the installer insisting on
trying to download a patch #26), though I did run into several other issues.

One example when using locally mirrored files:

Error connecting to URL:
http://software.internet2.edu/grouper/release/2.2.1/subjects.sql

Since I mirrored the
http://software.internet2.edu/grouper/release/2.2.1/ directory to the
local box, I believed that the file was not on the server.  However, I
just discovered that instead of letting the web server list the contents
of that directory, it appears that subjects.sql is there, but not in the
index.html.

Browse to:  http://software.internet2.edu/grouper/release/2.2.1/

and one gets no indication that there is a subjects.sql there (nor does
wget find it since it is not in the index).  Then,

Browse to: http://software.internet2.edu/grouper/release/2.2.1/subjects.sql

and one gets the SQL file.

Thanks,
Shannon


On 9/22/15 2:15 PM, Chris Hyzer wrote:
> It works for me I think, can you send a more detailed description about 
> what you did and what the output was etc?
> 
> Thanks,
> Chris
> 
> -----Original Message-----
> From: Shannon Roddy 
> [mailto:]
>  
> Sent: Tuesday, September 22, 2015 2:13 PM
> To: Chris Hyzer; 
> 
> Subject: Re: [grouper-users] Grouper installer without network connectivity
> 
> Right.  What I am saying is, that still fails, when run as documented at
> that link.
> 
> On 9/22/15 2:04 PM, Chris Hyzer wrote:
>> See this section:
>>
>> https://spaces.internet2.edu/display/Grouper/Grouper+Installer#GrouperInstaller-Runningwithoutnetwork
>>
>> thanks,
>> chris
>>
>> -----Original Message-----
>> From: 
>> 
>>  
>> [mailto:]
>>  On Behalf Of Shannon Roddy
>> Sent: Tuesday, September 22, 2015 2:01 PM
>> To: Chris Hyzer; 
>> 
>> Subject: Re: [grouper-users] Grouper installer without network connectivity
>>
>> With the files staged in the target directory, the installer will prompt
>> for one to use local files.  However, when the installer looks for
>> patches, it will still reach out to the network and then die when it
>> can't find "the next" patch file.  For example, if there are 25 patches
>> staged in the install directory (the number found at
>> http://www.internet2.edu/grouper/release/2.2.1/patches/), once the
>> installer has installed patch #25, it tries to download a nonexistent
>> patch #26 and times out.
>>
>> Our workaround was to set
>>
>> download.server.url = http://localhost/
>>
>> and then stage all the files in /var/www/html/...
>>
>> In this case, the installer presumably receives a 404 error from Apache,
>> and then assumes it has all the patches rather than continuing to look
>> for patch #26.
>>
>> Can the installer be updated to either
>>
>> A) make use of a http_proxy?
>> B) not fail on attempting to download a non-existent patch?
>>
>> Thanks,
>> Shannon
>>
>> On 9/16/15 4:49 PM, Shannon Roddy wrote:
>>> I think I figured out the problem.  The download files need to be
>>> mirrored in the target directory of the install, not the source
>>> (working) directory that the installer is run from.  This is quite
>>> counter-intuitive to me.
>>>
>>> We'll continue testing and see if we can get it going with the above.
>>>
>>> Thanks,
>>> Shannon
>>>
>>> On 9/16/15 3:02 PM, Chris Hyzer wrote:
>>>> Try to do everything the install, and the files and everything in the 
>>>> same directory.  Send me the output if it doesn’t work, I will take a 
>>>> look tonight.
>>>>
>>>> Thanks,
>>>> Chris
>>>>
>>>> -----Original Message-----
>>>> From: Shannon Roddy 
>>>> [mailto:]
>>>>  
>>>> Sent: Wednesday, September 16, 2015 2:59 PM
>>>> To: Chris Hyzer; 
>>>> 
>>>> Subject: Re: [grouper-users] Grouper installer without network 
>>>> connectivity
>>>>
>>>> Thanks, Chris.  Unfortunately though, it still fails.  Do the files need
>>>> to be in a special directory or something?  I.e. is there a hardcoded
>>>> path for the locally downloaded files?  They are in the same working
>>>> directory as I run the installer from at present.
>>>>
>>>> #cat grouper.installer.properties
>>>>
>>>> # this should be before the version number
>>>> #download.server.url = http://localhost:8090/grouper-ws/temp
>>>> download.server.url = http://software.internet2.edu/grouper
>>>>
>>>> # default version to install
>>>> grouper.version = 2.2.1
>>>>
>>>> # if should use local files only for development
>>>> grouperInstaller.useLocalFilesOnlyForDevelopment = t
>>>>
>>>> # java -cp .:grouperInstaller.jar
>>>> edu.internet2.middleware.grouperInstaller.GrouperInstaller
>>>> Do you want to 'install' a new installation of grouper, 'upgrade' an
>>>> existing installation,
>>>>   'patch' an existing installation, or 'createPatch' for Grouper 
>>>> developers
>>>>   (enter: 'install', 'upgrade', 'patch', 'createPatch' or blank for the
>>>> default) [install]:
>>>> Enter in the Grouper install directory (note: better if no spaces or
>>>> special chars) [/usr/local/src/grouper]: /opt/local
>>>> Enter the default IP address for checking ports (just hit enter to
>>>> accept the default unless on a machine with no network, might want to
>>>> change to 127.0.0.1): [0.0.0.0]:
>>>> Installing grouper version: 2.2.1
>>>> ............Sep 16, 2015 2:52:28 PM
>>>> edu.internet2.middleware.grouperInstallerExt.org.apache.commons.httpclient.HttpMethodDirector
>>>> executeMethod
>>>> INFO: I/O exception (java.net.ConnectException) caught when processing
>>>> request: Connection timed out
>>>> Sep 16, 2015 2:52:28 PM
>>>> edu.internet2.middleware.grouperInstallerExt.org.apache.commons.httpclient.HttpMethodDirector
>>>> executeMethod
>>>> INFO: Retrying request
>>>> .^C
>>>>
>>>> On 9/16/15 2:45 PM, Chris Hyzer wrote:
>>>>> I updated the wiki with new instructions that work :)
>>>>>
>>>>>  
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Chris
>>>>>
>>>>>
>>>>>         Running without network
>>>>>
>>>>> The Grouper installer requires the internet to download the Grouper
>>>>> tarballs.  If you want to run this without the network, download all the
>>>>> tarballs (example links for 2.2.1) (installer
>>>>> <http://www.internet2.edu/grouper/release/2.2.1/grouperInstaller.jar>, 
>>>>> apiBinary
>>>>> <http://www.internet2.edu/grouper/release/2.2.1/grouper.apiBinary-2.2.1.tar.gz>,
>>>>>  ui
>>>>> <http://www.internet2.edu/grouper/release/2.2.1/grouper.ui-2.2.1.tar.gz>,ws
>>>>> <http://www.internet2.edu/grouper/release/2.2.1/grouper.ws-2.2.1.tar.gz>,
>>>>>  client
>>>>> <http://www.internet2.edu/grouper/release/2.2.1/grouper.clientBinary-2.2.1.tar.gz>,
>>>>>  psp
>>>>> <http://software.internet2.edu/grouper/release/2.2.1/grouper.psp-2.2.1.tar.gz>)
>>>>> and the subjects file
>>>>> <http://www.internet2.edu/grouper/release/2.2.1/subjects.sql> (into
>>>>> subjects.sql), and quickstart file
>>>>> <http://www.internet2.edu/grouper/release/2.2.1/quickstart.xml> (into
>>>>> quickstart.xml), ant
>>>>> <http://www.internet2.edu/grouper/downloads/tools/apache-ant-1.8.2-bin.tar.gz>,
>>>>>  tomcat
>>>>> <http://www.internet2.edu/grouper/downloads/tools/apache-tomcat-6.0.35.tar.gz>
>>>>>  to
>>>>> the install directory.  Download all the patches
>>>>> <http://software.internet2.edu/grouper/release/2.2.1/patches/>.  When
>>>>> the script asks if you want to use the local files, type: t (or just
>>>>> <Enter> since the default is t)
>>>>>
>>>>> Make a grouper.installer.properties
>>>>>
>>>>> |#| |this| |should be before the version number|
>>>>>
>>>>> |#download.server.url = http://localhost:8090/grouper-ws/temp|
>>>>>
>>>>> |download.server.url = http://software.internet2.edu/grouper|
>>>>>
>>>>> | |
>>>>>
>>>>> |#| |default| |version to install|
>>>>>
>>>>> |grouper.version =| |2.2.1|
>>>>>
>>>>>  
>>>>>
>>>>> |#| |if| |should use local files only| |for| |development|
>>>>>
>>>>> |grouperInstaller.useLocalFilesOnlyForDevelopment = t|
>>>>>
>>>>>  
>>>>>
>>>>> Run the installer like this (note use a semicolon instead of a colon on
>>>>> windows):
>>>>>
>>>>> |java -cp .:grouperInstaller.jar
>>>>> edu.internet2.middleware.grouperInstaller.GrouperInstaller|
>>>>>
>>>>>  
>>>>>
>>>>>  
>>>>>
>>>>>  
>>>>>
>>>>> -----Original Message-----
>>>>> From: 
>>>>> 
>>>>> [mailto:]
>>>>>  On Behalf Of Shannon Roddy
>>>>> Sent: Tuesday, September 15, 2015 12:50 PM
>>>>> To: 
>>>>> 
>>>>> Subject: [grouper-users] Grouper installer without network connectivity
>>>>>
>>>>>  
>>>>>
>>>>> Hello,
>>>>>
>>>>>  
>>>>>
>>>>> According to the grouper wiki one can install grouper using local copies
>>>>>
>>>>> of the install files if the target machine does not have networking, or
>>>>>
>>>>> as in our case, is on a RFC1918 address space which is not NAT'd or
>>>>>
>>>>> routable to the public Internet.
>>>>>
>>>>>  
>>>>>
>>>>> Running without network
>>>>>
>>>>> The Grouper installer requires the internet to download the Grouper
>>>>>
>>>>> tarballs.  If you want to run this without the network, download all the
>>>>>
>>>>> tarballs (example links for 2.0.2) (apiBinary, ui, ws, client) and the
>>>>>
>>>>> subjects file (into subjects.sql), and quickstart file (into
>>>>>
>>>>> quickstart.xml), ant, tomcat to the install directory.  When the script
>>>>>
>>>>> asks if you want to use the local files, type: t (or just <Enter> since
>>>>>
>>>>> the default is t)
>>>>>
>>>>>  
>>>>>
>>>>>  
>>>>>
>>>>> We have downloaded all of the files as documented above, but the
>>>>>
>>>>> installer never prompts for local files to be used.  See below:
>>>>>
>>>>>  
>>>>>
>>>>> # ls -1
>>>>>
>>>>> grouper.api-2.2.1.tar.gz
>>>>>
>>>>> grouper.apiBinary-2.2.1.tar.gz
>>>>>
>>>>> grouper.client-2.2.1.tar.gz
>>>>>
>>>>> grouper.clientBinary-2.2.1.tar.gz
>>>>>
>>>>> grouper.installer-2.2.1
>>>>>
>>>>> grouper.installer-2.2.1.tar.gz
>>>>>
>>>>> grouper.installer-2.2.1.tar.gz.20141115
>>>>>
>>>>> grouperInstaller.jar
>>>>>
>>>>> grouperInstaller.jar.20141115
>>>>>
>>>>> grouper.psp-2.2.1.tar.gz
>>>>>
>>>>> grouper.ui-2.2.1.tar.gz
>>>>>
>>>>> grouper.ws-2.2.1.tar.gz
>>>>>
>>>>> index.html
>>>>>
>>>>> patches
>>>>>
>>>>> patches.1
>>>>>
>>>>> quickstart.xml
>>>>>
>>>>> subjects.sql
>>>>>
>>>>>  
>>>>>
>>>>> # java -jar grouperInstaller.jar
>>>>>
>>>>> Do you want to 'install' a new installation of grouper, 'upgrade' an
>>>>>
>>>>> existing installation,
>>>>>
>>>>>   'patch' an existing installation, or 'createPatch' for Grouper 
>>>>> developers
>>>>>
>>>>>   (enter: 'install', 'upgrade', 'patch', 'createPatch' or blank for the
>>>>>
>>>>> default) [install]:
>>>>>
>>>>> Enter in the Grouper install directory (note: better if no spaces or
>>>>>
>>>>> special chars) [/usr/local/src/grouper]: /opt/local
>>>>>
>>>>> Enter the default IP address for checking ports (just hit enter to
>>>>>
>>>>> accept the default unless on a machine with no network, might want to
>>>>>
>>>>> change to 127.0.0.1): [0.0.0.0]:
>>>>>
>>>>> Installing grouper version: 2.2.1
>>>>>
>>>>> ............Sep 15, 2015 12:41:02 PM
>>>>>
>>>>> edu.internet2.middleware.grouperInstallerExt.org.apache.commons.httpclient.HttpMethodDirector
>>>>>
>>>>> executeMethod
>>>>>
>>>>> INFO: I/O exception (java.net.ConnectException) caught when processing
>>>>>
>>>>> request: Connection timed out
>>>>>
>>>>> Sep 15, 2015 12:41:02 PM
>>>>>
>>>>> edu.internet2.middleware.grouperInstallerExt.org.apache.commons.httpclient.HttpMethodDirector
>>>>>
>>>>> executeMethod
>>>>>
>>>>> INFO: Retrying request
>>>>>
>>>>>  
>>>>>
>>>>> Alternatively to installing from local files, we do have an HTTP proxy
>>>>>
>>>>> set up for the host, and are able to do things like wget, curl, etc. if
>>>>>
>>>>> someone knows how to get the installer to pick up the proxy value.
>>>>>
>>>>> e.g., this also fails:
>>>>>
>>>>>  
>>>>>
>>>>> # export JAVA_FLAGS="-Dhttp.proxyHost=xxxx.psu.edu 
>>>>> -Dhttp.proxyPort=3128"
>>>>>
>>>>> # java ${JAVA_FLAGS} -jar grouperInstaller.jar
>>>>>
>>>>>  
>>>>>
>>>>> Thank you,
>>>>>
>>>>> Shannon Roddy
>>>>>