Grouper Users - Open Discussion List

[Tornóci László <>]

Hi Chad,

On 12/30/18 4:30 PM, Redman, Chad wrote:
> Szia László,
>
> If you add this parameter, it may be what is missing.
>
> subjectApi.source.sourceSeu.param.dbDriver.value = com.mysql.jdbc.Driver

that fixed the problem. Thanks a lot!

> For C3p0, you can also define properties for (showing defaults):
>
> (max pool size) subjectApi.source.sourceSeu.param.maxActive.value = 2
> (max wait seconds for timeout) 
> subjectApi.source.sourceSeu.param.maxWait.value = 5
>
>
> I will create a new issue to update the documentation for this. Also, the 
> code should check for the driver parameter being defined and give a warning 
> if not, rather than a null pointer exception. In fact, the driver isn't 
> really necessary if it's already loaded. The parameter just forces it to be 
> loaded if it's not.

That'll be very helpful for grouper newbies like me :-)

Laszlo

> -Chad
>
>
>
> -----Original Message-----
> From: 
>
>  
> [mailto:]
>  On Behalf Of Tornóci László
> Sent: Sunday, December 30, 2018 4:46 AM
> To: 
>
> Subject: Re: [grouper-users] Cannot use external sql subject source
>
> Hi Chris,
>
> thank you for your answer.
>
> On 12/30/18 4:01 AM, Hyzer, Chris wrote:
> > Please review this example:
> >
> > https://spaces.at.internet2.edu/display/Grouper/Penn+subject+source+JDBC2+example
>
> That's exactly what I did, however, I had the problem described in my
> original message.
>
> > And please run the subject api diagnostics under misc in the UI
> I can build the UI successfully, however tomcat gives me 404 if I
> include my additional subject source definition in subject.properties,
> so there no way to see what the subject api diagnostics would say.
> That's why I tried to start gsh, but that gives me the stack trace
> posted in my original message. It works fine with the vanilla
> subject.properties, so the problem must be my addition.
>
> > Let me know if you need further help.
>
> I am sure it is something trivial, but I really don't know what is my
> mistake. I installed grouper using grouperInstaller.jar on a Fedora29
> system. The credentials to access mariadb are correct. I even tried
> putting subject-2.1.3.jar to grouper.apiBinary-2.4.0/lib/custom to make
> sure C3p0JdbcConnectionProvider.class is available, but that didn't make
> any difference. Any suggestions?
>
> Yours: Laszlo
>
> > Thanks
> > Chris
> >
> > -----Original Message-----
> > From: 
> >
> >  
> > <>
> >  On Behalf Of Tornóci László
> > Sent: Friday, December 28, 2018 4:07 PM
> > To: 
> >
> > Subject: [grouper-users] Cannot use external sql subject source
> >
> > Hi,
> >
> > I am just starting to learn grouper. So I installed 2.4 with all the
> > latest patches using mariadb for SQL backend. The UI works fine with the
> > test data. I was trying to set up my own SQL subject source as described
> > here:
> > https://spaces.at.internet2.edu/display/Grouper/Penn+subject+source+JDBC2+example
> >
> > gsh works with the vanilla subject.properties containing the "Example
> > JDBC Source Adapter". However, gsh won't start if I add this section to
> > subject.properties:
> >
> > #########################################
> > ## Configuration for source id: sourceSeu
> > ## Source configName: sourceSeu
> > #########################################
> > subjectApi.source.sourceSeu.id = sourceSeu
> >
> > # this is a friendly name for the source
> > subjectApi.source.sourceSeu.name = SE people
> >
> > # type is not used all that much.  Can have multiple types, comma
> > separate.  Can be person, group, application
> > subjectApi.source.sourceSeu.types = person
> >
> > # the adapter class implements the interface:
> > edu.internet2.middleware.subject.Source
> > subjectApi.source.sourceSeu.adapterClass =
> > edu.internet2.middleware.grouper.subj.GrouperJdbcSourceAdapter2
> >
> > subjectApi.source.sourceSeu.param.jdbcConnectionProvider.value =
> > edu.internet2.middleware.subject.provider.C3p0JdbcConnectionProvider
> >
> > subjectApi.source.sourceSeu.param.dbUrl.value =
> > jdbc:mysql://localhost:3306/grouper_testdata
> >
> > # username when connecting to the database
> > subjectApi.source.sourceSeu.param.dbUser.value = grouperuser
> >
> > # password when connecting to the database (or file with encrypted
> > password inside)
> > subjectApi.source.sourceSeu.param.dbPwd.value = password_here
> >
> > # maximum number of results from a search, generally no need to get more
> > than 1000
> > subjectApi.source.sourceSeu.param.maxResults.value = 100
> >
> > # the table or view to query results from.  Note, could prefix with a
> > schema name
> > subjectApi.source.sourceSeu.param.dbTableOrView.value = person_source
> >
> > # the column name to get the subjectId from
> > subjectApi.source.sourceSeu.param.subjectIdCol.value = uid
> >
> > # the column name to get the name from
> > subjectApi.source.sourceSeu.param.nameCol.value = name
> >
> > subjectApi.source.sourceSeu.param.descriptionCol.value = description
> >
> > # search col where general searches take place, lower case
> > subjectApi.source.sourceSeu.param.lowerSearchCol.value = description_lower
> >
> > # optional col if you want the search results sorted in the API (note,
> > UI might override)
> > subjectApi.source.sourceSeu.param.defaultSortCol.value = description
> >
> > # you can count up from 0 to N of columns to search by identifier (which
> > might also include by id)
> > subjectApi.source.sourceSeu.param.subjectIdentifierCol0.value = sapid
> >
> > # now you can count up from 0 to N of attributes for various cols.  The
> > name is how to reference in subject.getAttribute()
> > subjectApi.source.sourceSeu.param.subjectAttributeCol0.value = email
> >
> > The same setup works fine, if I copy the data to the database that
> > grouper itself uses and I set GrouperJdbcConnectionProvider instead of
> > GrouperJdbcSourceAdapter2 as an adapterClass.
> >
> > I don't know what I'm doing wrong. Thank you for your help:
> >
> > Laszlo
> >
> > Here is the stack trace of gsh:
> > ./gsh.sh
> > Detected Grouper directory structure 'api' (valid is api or webapp)
> > Using GROUPER_HOME:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0
> > Using GROUPER_CONF:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/conf
> > Using JAVA:                   /etc/alternatives/java_sdk/bin/java
> > Using CLASSPATH:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/conf:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/dist/lib/grouper.jar:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/lib/grouper/*:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/lib/custom/*:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/lib/jdbcSamples/*:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/lib/ant/*:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/lib/test/*:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/dist/lib/test/*:/home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/src/resources
> > using MEMORY:                 64m-750m
> > log4j:WARN No such property [maxBackupIndex] in
> > org.apache.log4j.DailyRollingFileAppender.
> > Grouper starting up: version: 2.4.0, build date: 2018/08/23 07:48:38,
> > env: <no label configured>
> > grouperPatchStatus read from:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/grouperPatchStatus.properties
> > api patches installed:        0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
> > pspng patches installed:      0, 1
> > grouper.properties read from:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/conf/grouper.properties
> > Grouper current directory is:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/bin
> > log4j.properties read from:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/conf/log4j.properties
> > Grouper is logging to file:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/logs/grouper_error.log,
> > at min level WARN for package: edu.internet2.middleware.grouper, based
> > on log4j.properties
> > grouper.hibernate.properties:
> > /home/torlasz/src/grouper24/app/test/grouper.apiBinary-2.4.0/conf/grouper.hibernate.properties
> > grouper.hibernate.properties:
> > grouperuser@jdbc:mysql://localhost:3306/grouper_test?CharSet=utf8&useUnicode=true&characterEncoding=utf8
> > problem with sources
> > Couldnt startup grouper: Error initializing SourceManager
> > java.lang.RuntimeException: Error initializing SourceManager
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.init(SourceManager.java:326)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.<init>(SourceManager.java:256)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.getInstance(SourceManager.java:266)
> >            at
> > edu.internet2.middleware.grouper.misc.GrouperStartup.startup(GrouperStartup.java:284)
> >            at
> > edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:165)
> >            at
> > edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31)
> > Caused by: edu.internet2.middleware.subject.SourceUnavailableException:
> > Unable to init subject.properties JDBC source, source: sourceSeu
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.init(JDBCSourceAdapter.java:815)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.loadSource(SourceManager.java:351)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.parseConfig(SourceManager.java:365)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.init(SourceManager.java:323)
> >            ... 5 more
> > Caused by: edu.internet2.middleware.subject.SourceUnavailableException:
> > Error loading subject.properties JDBC driver: null, source: sourceSeu
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.loadDriver(JDBCSourceAdapter.java:831)
> >            at
> > edu.internet2.middleware.subject.provider.C3p0JdbcConnectionProvider.init(C3p0JdbcConnectionProvider.java:129)
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter2.setupDataSource(JDBCSourceAdapter2.java:649)
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.init(JDBCSourceAdapter.java:759)
> >            ... 8 more
> > Caused by: java.lang.NullPointerException
> >            at java.lang.Class.forName0(Native Method)
> >            at java.lang.Class.forName(Class.java:264)
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.loadDriver(JDBCSourceAdapter.java:828)
> >            ... 11 more
> > Exception in thread "main" java.lang.RuntimeException: Error
> > initializing SourceManager
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.init(SourceManager.java:326)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.<init>(SourceManager.java:256)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.getInstance(SourceManager.java:266)
> >            at
> > edu.internet2.middleware.grouper.misc.GrouperStartup.startup(GrouperStartup.java:284)
> >            at
> > edu.internet2.middleware.grouper.app.gsh.GrouperShell.main(GrouperShell.java:165)
> >            at
> > edu.internet2.middleware.grouper.app.gsh.GrouperShellWrapper.main(GrouperShellWrapper.java:31)
> > Caused by: edu.internet2.middleware.subject.SourceUnavailableException:
> > Unable to init subject.properties JDBC source, source: sourceSeu
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.init(JDBCSourceAdapter.java:815)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.loadSource(SourceManager.java:351)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.parseConfig(SourceManager.java:365)
> >            at
> > edu.internet2.middleware.subject.provider.SourceManager.init(SourceManager.java:323)
> >            ... 5 more
> > Caused by: edu.internet2.middleware.subject.SourceUnavailableException:
> > Error loading subject.properties JDBC driver: null, source: sourceSeu
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.loadDriver(JDBCSourceAdapter.java:831)
> >            at
> > edu.internet2.middleware.subject.provider.C3p0JdbcConnectionProvider.init(C3p0JdbcConnectionProvider.java:129)
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter2.setupDataSource(JDBCSourceAdapter2.java:649)
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.init(JDBCSourceAdapter.java:759)
> >            ... 8 more
> > Caused by: java.lang.NullPointerException
> >            at java.lang.Class.forName0(Native Method)
> >            at java.lang.Class.forName(Class.java:264)
> >            at
> > edu.internet2.middleware.subject.provider.JDBCSourceAdapter.loadDriver(JDBCSourceAdapter.java:828)
> >            ... 11 more