Skip to Content.
Sympa Menu

grouper-dev - [grouper-dev] Re: [grouper-core] RE: [grouper-users] grouper-loader help

Subject: Grouper Developers Forum

List archive

[grouper-dev] Re: [grouper-core] RE: [grouper-users] grouper-loader help


Chronological Thread 
  • From: Shilen Patel <>
  • To: Wayne Hall <>, "" <>
  • Subject: [grouper-dev] Re: [grouper-core] RE: [grouper-users] grouper-loader help
  • Date: Fri, 16 Oct 2015 14:41:30 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:23


I created API and UI patches that can be applied on a Grouper 2.2.2 install.

grouper_v2_2_2_api_patch_0
grouper_v2_2_2_ui_patch_0

Thanks!

- Shilen

From: Chris Hyzer <>
Date: Friday, October 9, 2015 at 12:10 AM
To: Wayne Hall <>
Cc: "" <>
Subject: [grouper-core] RE: [grouper-users] grouper-loader help

There are subjects in the view which cannot be resolved.  Can you resolve the subjects from GSH or the UI by the ID or identifier?  If you don’t know what I mean, send me the column names and data from the view and I will give you GSH to run to see if you can resolve them.  You need to join your view to a table that has valid grouper subjects so there are no unresolvables in the loader query.  Ok?

 

It’s a bug if GHS or the UI returns success if there are subject problems.  I opened a jira for that

 

https://bugs.internet2.edu/jira/browse/GRP-1212

 

Thanks,

Chris

 

From: Wayne Hall []
Sent: Thursday, October 08, 2015 6:47 PM
To: Chris Hyzer
Subject: Re: [grouper-users] grouper-loader help

 

Hi Chris,

I have some updates, answers, and questions.

On our HR database I had a view created and can successfully make queries from it.

On grouper, using the grouper loader group, "employees" and a plain query in the grouperLoaderQuery attributes all seems to work.  When I use the UI and select my group "employees" and under More actions, select "Run loader process to sync group", a message in green appears.  However, I expect an insert of 6 memberships.


Looking at the grouper_loader_log table a status of "SUBJECT_PROBLEMS" appears as well as no inserts.  Also the WS Type=all gives this:
"There was an error in the diagnostic task DiagnosticLoaderJobTest, Loader job SQL_SIMPLE__CSU:employees__26af86f5d32f48b1b58204acca343039"

A web search I find this: http://www.internet2.edu/grouper/release/1.6.0/doc/api/edu/internet2/middleware/grouper/app/loader/GrouperLoaderStatus.html#SUBJECT_PROBLEMS

So I am not sure what table (or where in the grouper registry) these inserts should appear, or this end of the process?  My understanding is to create the view on our HR db, use grouper loader to make a query against that view, which provisions the grouper db (registry).  Seems like I am not able to write those inserts properly.

Suggestions...
Thanks,
Wayne


On 09/28/2015 05:14 PM, Chris Hyzer wrote:

Um… if you have the query, and the database setup correctly then it should either insert or log something in the logs.  Do you have anything in the logs?

 

From: Wayne Hall []
Sent: Monday, September 28, 2015 4:51 PM
To: Chris Hyzer
Subject: Re: [grouper-users] grouper-loader help

 

Chris,

Thanks, I will continue to use all files, and ignore those warnings.

No, the grouper-loader query does not return 5 members as I expect.  That is the issue.  Also the grouper_loader_log table does not seem to update.  I was expecting to see a success status after running either gsh or the New UI method with an insert_count of 5.

Does this help, what more info can I provide?

Thanks,
Wayne

On 09/28/2015 07:44 AM, Chris Hyzer wrote:

Yes, you should keep the config files for the loader in all your deployments.  Does the query return 5 members?  What is the issue?

 

You can ignore those GSH warnings

 

Thanks,

Chris

 

From: [] On Behalf Of Wayne Hall
Sent: Friday, September 25, 2015 10:32 AM
To:
Subject: [grouper-users] grouper-loader help

 

Hi,

Using this video as a guide to setup a test case grouper loader, for the most part seems to work. However I am experiencing some issues provisioning members to our employees grouper-loader group.

In our setup we will query from a remote mssql db, and it seems the query is working.  From the NewUI I can use the "Run loader process to sync group" on the employee group, and get a Success message as follows: Success: the group was updated via loader Loader ran successfully, inserted 0 memberships, deleted 0 memberships, total membership count: 5.

However running gsh -loader gives a Warning & Error as follows: Grouper warning: jarfile mismatch, expecting name: 'subject.jar' size: 260483 manifest version: 2.2.1. However the jar detected is: /path/to/grouper.apiBinary-2.2.1/lib/grouper/subject.jar, name: subject.jar size: 259419 manifest version: 2.2.1  Error: Cannot properly read UTF string from resource: grouperUtf8.txt: 'ٹٺٻټكلل'

And after running those methods, no member changes are made to the employees grouper-loader group verified under AdminUI.

The three grouper.hibernate.properties files (api, ui, ws) are as follows:

hibernate.connection.url = "jdbc:mysql://localhost:3306/grouper

hibernate.connection.username = grouper

hibernate.connection.password = /path/to/key.txt

And the three grouper-loader.properties files (api, ui, ws) are as follows:

db.dbname.user = dbusername

db.dbname.pass = /path/to/key.txt

db.dbname.url = "jdbc:sqlserver://remote_mssql.edu

Questions: do all three (api, ui, and ws) hibernate and loader files need to be edited (are they all used/needed)? In terms of managing the employees group using the grouper-loader, is there something obvious I am missing in trying to add members?

Thanks,

Wayne

 

 



  • [grouper-dev] Re: [grouper-core] RE: [grouper-users] grouper-loader help, Shilen Patel, 10/16/2015

Archive powered by MHonArc 2.6.16.

Top of Page