Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] Real-time loader issue

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] Real-time loader issue


Chronological Thread 
  • From: "Gettes, Michael" <>
  • To: Shilen Patel <>
  • Cc: "" <>
  • Subject: Re: [grouper-users] Real-time loader issue
  • Date: Fri, 13 Jul 2018 16:02:55 +0000
  • Accept-language: en-US
  • Ironport-phdr: 9a23:5NNrvhK4tcJNH5U/Q9mcpTZWNBhigK39O0sv0rFitYgXKv35rarrMEGX3/hxlliBBdydt6oazbKO+4nbGkU4qa6bt34DdJEeHzQksu4x2zIaPcieFEfgJ+TrZSFpVO5LVVti4m3peRMNQJW2aFLduGC94iAPERvjKwV1Ov71GonPhMiryuy+4ZLebxlJiTanfb9+MAi9oBnMuMURnYZsMLs6xAHTontPdeRWxGdoKkyWkh3h+Mq+/4Nt/jpJtf45+MFOTav1f6IjTbxFFzsmKHw65NfqtRbYUwSC4GYXX3gMnRpJBwjF6wz6Xov0vyDnuOdxxDWWMMvrRr0vRz+s87lkRwPpiCcfNj427mfXitBrjKlGpB6tvgFzz5LIbI2QMvd1Y6HTcs4ARWdZXshfSTFPAp+yYYUMAeoOP+FWr4jhqFQBthaxHxWgBOb1xz9ImnP736s32PkhHwHc2wwgGsoDvHrVotrrKKcSTf66zLLQwT7eaP1W2Cvy6IjSfR8/pfGAU697fM3eyUYxCwPFkkufqZf+MjOI2OQNt3KX4PR9WuKykmMqrRx6rDaoxscpkIbJh4QVx0jL9SVjx4Y1OMW4R1BhYdK+CpRQrzmaO5N3QsMkX2Fnpjw6yrsYtp6nYiQG0oooyAPCa/Cfb4iI4gjjW/iLLjhlnn5lYq+/hxCq/Ui40O38Uc600FhSripCk9nMsGwN2wbP5ciAT/tx5kih2SyI1wDO8uFLP1o0mrbBJJ4lxr4/jIEcsUDdESPshEr5lquWdkE89uim9uTnfqjmpoWCOI9okA7+KacultalAeQlNAgDWXWQ9+ek1LD74EH1XrZHguconqXHsp3WP8YWq6GjDwNLz4ou7w6zAyq63NgCk3QKLUhJdA+DgoXqIV3CPf/1Ae+xg1uykzpn2/XLM7jiD5jJMnTMjLLscqpm5EFGyAc+yM5T6pBPBb0fJf/8R1T+uMLaAxI/Lge62fzoCM9n2YMbQW+PArGWMKfVsVKQ/eIvJvWMZJcPtDbgJfgl4+TigmEkll8AZaWp3J0XZ26kHvl+PkmVf3nhjs0fHWsUvAcyVu7nhVKYXTJNenq/W7ow5jQhB4KnCYfDSJqtgLuE3CqjEZ1ZeHxGCkySHnfzbIiERvkMaCaILsB/jzMESKCtS5U92hG2qA/6171nI/Lb+i0CspLjycB16PPJlR0r6Dx0FNqS03uWT2xvmmMIRiQ23LxkoUBj0FuD0K54g+BGGtxJ4fNGTBs6OYDGw+NkFt/yR1GJQtDcc1anRtigSQk4Ut81i4sVY0d5FtOKgg3A0mynD6JDxJKRA5lhuI3Rw2T8PII17nfN1KAsixNuFsRCKXGrnYZi+QyVCoLUxRbK3522fLgRiXaevFyIynCD6QQBCFZ9

Yes, I was getting a SQL error if the column in myincrementaltable was ‘source_id’ - something about invalid where clause.  When I renamed the column to be subject_source_id it worked and then I got to the error I reported this morning.

/mrg

On Jul 13, 2018, at 11:11 AM, Shilen Patel <> wrote:

>> The example SQL is broken where source_id should be subject_source_id.  
 
Are you referring to the incremental table?  E.g. myincrementaltable in the example?
 
There, I think, it should be source_id.  Does that give you an error or something unexpected?
 
Thanks!
 
- Shilen
 
From: <> on behalf of "Gettes, Michael" <>
Date: Friday, July 13, 2018 at 8:23 AM
To: "" <>
Subject: [grouper-users] Real-time loader issue
 
I am trying to make use of the Real-time loader (looks really neat).
 
I am using the example for mySQL as documented at https://spaces.internet2.edu/display/Grouper/Grouper+loader+real+time+updates
 
The example SQL is broken where source_id should be subject_source_id.  I am setting subject_source_id but it doesn’t appear it is being respected as the following stack trace shows.  Yes, I understand the rules of uniqueness but this is what I have for now and if RTL could respect subject source this would be so cool.  If I am not doing something stupid, happy to submit as Jira bug.
 
Thanks!
 
/mrg
 
daemon_1    | 2018-07-13T12:15:30.835152680Z grouper-api;grouper_error.log;dev;build-2;2018-07-13 08:15:30,818: [DefaultQuartzScheduler_Worker-8] WARN  GrouperFuture.waitForJob(155) -  - Non fatal problem with callable.  Will try again not in thread
daemon_1    | 2018-07-13T12:15:30.835205366Z java.lang.RuntimeException: edu.internet2.middleware.subject.SubjectNotUniqueException: found multiple matching subjects: 2, '',
daemon_1    | 2018-07-13T12:15:30.835215461Z Problem in job: processOneRow
daemon_1    | 2018-07-13T12:15:30.835222117Z 
at edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.processOneRow(GrouperLoaderIncrementalJob.java:720)
daemon_1    | 2018-07-13T12:15:30.835229332Z 
at edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.access$000(GrouperLoaderIncrementalJob.java:73)
daemon_1    | 2018-07-13T12:15:30.835235791Z 
at edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob$1.callLogic(GrouperLoaderIncrementalJob.java:286)
daemon_1    | 2018-07-13T12:15:30.835242340Z 
at edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob$1.callLogic(GrouperLoaderIncrementalJob.java:281)
daemon_1    | 2018-07-13T12:15:30.835248836Z 
at edu.internet2.middleware.grouper.util.GrouperCallable$1.callback(GrouperCallable.java:191)
daemon_1    | 2018-07-13T12:15:30.835255124Z 
at edu.internet2.middleware.grouper.GrouperSession.callbackGrouperSession(GrouperSession.java:974)
daemon_1    | 2018-07-13T12:15:30.835261295Z 
at edu.internet2.middleware.grouper.util.GrouperCallable.callLogicWithSessionIfExists(GrouperCallable.java:188)
daemon_1    | 2018-07-13T12:15:30.835267627Z 
at edu.internet2.middleware.grouper.util.GrouperCallable.call(GrouperCallable.java:154)
daemon_1    | 2018-07-13T12:15:30.835294130Z 
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
daemon_1    | 2018-07-13T12:15:30.835301560Z 
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
daemon_1    | 2018-07-13T12:15:30.835307679Z 
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
daemon_1    | 2018-07-13T12:15:30.835314161Z 
at java.lang.Thread.run(Thread.java:748)
daemon_1    | 2018-07-13T12:15:30.835320307Z Caused by: edu.internet2.middleware.subject.SubjectNotUniqueException: found multiple matching subjects: 2, ''
daemon_1    | 2018-07-13T12:15:30.835326661Z 
at edu.internet2.middleware.grouper.subj.SourcesXmlResolver.thereCanOnlyBeOne(SourcesXmlResolver.java:492)
daemon_1    | 2018-07-13T12:15:30.835332933Z 
at edu.internet2.middleware.grouper.subj.SourcesXmlResolver.find(SourcesXmlResolver.java:133)
daemon_1    | 2018-07-13T12:15:30.835339153Z 
at edu.internet2.middleware.grouper.subj.CachingResolver.find(CachingResolver.java:125)
daemon_1    | 2018-07-13T12:15:30.835346665Z 
at edu.internet2.middleware.grouper.subj.ValidatingResolver.find(ValidatingResolver.java:91)
daemon_1    | 2018-07-13T12:15:30.835352997Z 
at edu.internet2.middleware.grouper.SubjectFinder.findById(SubjectFinder.java:470)
daemon_1    | 2018-07-13T12:15:30.835359154Z 
at edu.internet2.middleware.grouper.app.loader.GrouperLoaderIncrementalJob.processOneRow(GrouperLoaderIncrementalJob.java:471)
daemon_1    | 2018-07-13T12:15:30.835365729Z 

... 11 more





Archive powered by MHonArc 2.6.19.

Top of Page