Grouper Users - Open Discussion List

[Shilen Patel <>]

OK I see.  I think it’s that way because the assumption is that you would put 
triggers on your loader tables to populate the incremental table, so the same 
database would generally be used.  But I could see that this makes it harder 
to do testing and proof of concept work.  We’re planning on making a series 
of updates to the real time loader after 2.4 is released so I appreciate the 
feedback.

Thanks!

- Shilen

On 7/13/18, 4:48 PM, 
"
 on behalf of Gettes, Michael" 
<
 on behalf of 
>
 wrote:

    Never mind - I think I get it now.  I am using the incremental table in a 
mySQL (MariaDB) database but the loader job ultimately being executed goes 
against Oracle.  So, I guess I can’t use the incremental loader until I can 
get appropriate Oracle access.  Bummer.  Would have been nice if the 
instantiation of the loaderjob was separate from the incremental job but I 
think I get there must be some reason one has to use the existing context.
    
    Sniffle, sniffle.
    
    /mrg
    
    > On Jul 13, 2018, at 4:37 PM, Gettes, Michael 
<>
 wrote:
    > 
    > I am trying to continue down the path of making use of the realtime 
loader and I am having a SQL error.  I have turned up logging to DEBUG on 
edu.internet2.middleware.grouper.app.loader but I am not getting any useful 
output other than what is below.  How can I better see the actual statement 
creating the error?  I get the impression my loaderJob SQL is being wrapped 
by something else and that’s failing but I can’t see what is actually failing.
    > 
    > Pointers appreciated.
    > 
    > /mrg
    > 
    > daemon_1    | 2018-07-13T20:34:30.176376217Z 
grouper-api;grouper_error.log;dev;build-2;2018-07-13 16:34:30,175: 
[DefaultQuartzScheduler_Worker-7] ERROR 
GrouperLoaderIncrementalJob.runJob(336) -  - Error running job
    > daemon_1    | 2018-07-13T20:34:30.176434695Z 
java.lang.RuntimeException: 
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error 
in your SQL syntax; check the manual that corresponds to your MariaDB server 
version for the right syntax to use near '@SHIBPRD_pub p, Role_List RL where 
p.ARP_PAR_UFID = r.ROLEUSER and r.rolename=RL' at line 1,
    > daemon_1    | 2018-07-13T20:34:30.176444634Z 1 callables out of problem 
count 1 had problems running outside of threads!
    > daemon_1    | 2018-07-13T20:34:30.176450505Z      at 
edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.processOneRow(GrouperLoaderIncrementalJob.java:720)
    > daemon_1    | 2018-07-13T20:34:30.176455791Z      at 
edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.access$000(GrouperLoaderIncrementalJob.java:73)
    > daemon_1    | 2018-07-13T20:34:30.176460452Z      at 
edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob$1.callLogic(GrouperLoaderIncrementalJob.java:286)
    > daemon_1    | 2018-07-13T20:34:30.176464931Z      at 
edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob$1.callLogic(GrouperLoaderIncrementalJob.java:281)
    > daemon_1    | 2018-07-13T20:34:30.176469333Z      at 
edu.internet2.middleware.grouper.util.GrouperCallable.tryCallablesWithProblems(GrouperCallable.java:51)
    > daemon_1    | 2018-07-13T20:34:30.176473956Z      at 
edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.runJob(GrouperLoaderIncrementalJob.java:308)
    > daemon_1    | 2018-07-13T20:34:30.176478163Z      at 
edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.execute(GrouperLoaderIncrementalJob.java:94)
    > daemon_1    | 2018-07-13T20:34:30.176483959Z      at 
org.quartz.core.JobRunShell.run(JobRunShell.java:202)
    > daemon_1    | 2018-07-13T20:34:30.176488543Z      at 
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
    > daemon_1    | 2018-07-13T20:34:30.176493674Z Caused by: 
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error 
in your SQL syntax; check the manual that corresponds to your MariaDB server 
version for the right syntax to use near '@SHIBPRD_pub p, Role_List RL where 
p.ARP_PAR_UFID = r.ROLEUSER and r.rolename=RL' at line 1
    > daemon_1    | 2018-07-13T20:34:30.176499131Z      at 
sun.reflect.GeneratedConstructorAccessor99.newInstance(Unknown Source)
    > daemon_1    | 2018-07-13T20:34:30.176503352Z      at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    > daemon_1    | 2018-07-13T20:34:30.176509368Z      at 
java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    > daemon_1    | 2018-07-13T20:34:30.176514977Z      at 
com.mysql.jdbc.Util.handleNewInstance(Util.java:404)
    > daemon_1    | 2018-07-13T20:34:30.176519375Z      at 
com.mysql.jdbc.Util.getInstance(Util.java:387)
    > daemon_1    | 2018-07-13T20:34:30.176540322Z      at 
com.mysql.jdbc.SQLError.createSQLException(SQLError.java:939)
    > daemon_1    | 2018-07-13T20:34:30.176545670Z      at 
com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3878)
    > daemon_1    | 2018-07-13T20:34:30.176550501Z      at 
com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3814)
    > daemon_1    | 2018-07-13T20:34:30.176555287Z      at 
com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2478)
    > daemon_1    | 2018-07-13T20:34:30.176560002Z      at 
com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2625)
    > daemon_1    | 2018-07-13T20:34:30.176565012Z      at 
com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2551)
    > daemon_1    | 2018-07-13T20:34:30.176570002Z      at 
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1861)
    > daemon_1    | 2018-07-13T20:34:30.176575144Z      at 
com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1962)
    > daemon_1    | 2018-07-13T20:34:30.176579983Z      at 
com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeQuery(NewProxyPreparedStatement.java:353)
    > daemon_1    | 2018-07-13T20:34:30.176585062Z      at 
edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.processOneRow(GrouperLoaderIncrementalJob.java:601)
    > daemon_1    | 2018-07-13T20:34:30.176590460Z      ... 8 more
    >