Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] Re: [JIRA] (GRP-1381) Use member table subject identifier in loader jobs to improve performance

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] Re: [JIRA] (GRP-1381) Use member table subject identifier in loader jobs to improve performance


Chronological Thread 
  • From: Jared Hoffman <>
  • To: Shilen Patel <>
  • Cc: "" <>
  • Subject: Re: [grouper-users] Re: [JIRA] (GRP-1381) Use member table subject identifier in loader jobs to improve performance
  • Date: Fri, 14 Oct 2016 17:11:53 -0400
  • Ironport-phdr: 9a23:0PT42RETrLzWH/IcqAKlvZ1GYnF86YWxBRYc798ds5kLTJ76rsiwAkXT6L1XgUPTWs2DsrQf1LqQ7vurADFIyK3CmU5BWaQEbwUCh8QSkl5oK+++Imq/EsTXaTcnFt9JTl5v8iLzG0FUHMHjew+a+SXqvnY6Uy/yPgttJ+nzBpWaz4Huj7jzqNXvZFBzhDu5bLU6FByqoAGZ4tIWgI9vLI491xjE5HZEZrIF63lvIAexlgzx6o+Q+5Bt9i1W86Yh8MBOVKz8fYw7QLpJCzJgPmwosp64/SLfRBeCsyNPGl4dlQBFVk2ctEn3

I thought I had patched all components but it looks like I missed the UI. It is working now.


Thanks,

Jared


On Fri, Oct 14, 2016 at 4:55 PM, Shilen Patel <> wrote:


From: Jared Hoffman <>
Date: Friday, October 14, 2016 at 4:40 PM
To: Shilen Patel <>
Cc: "" <>
Subject: Re: [grouper-users] Re: [JIRA] (GRP-1381) Use member table subject identifier in loader jobs to improve performance

Wonderful, thank you! I can confirm similar levels of improvement with our data. 

For 1820 members, 320 seconds down to 4.5 seconds.
For 146 members, 26 seconds down to < 1 second.

That's great to hear!



I also tested this with the "run loader process to sync group" in the UI. The patch appears to only affect the scheduled cron tasks. I did configure the subjectIdentifierAttribute0 in the sources.xml for the UI and API.



Did you patch the UI as well?

Thanks!

- Shilen







On Fri, Oct 14, 2016 at 12:13 PM, Shilen Patel <> wrote:
I've added a new patch for 2.3 that significantly improves the performance of the loader in cases where you're using a subject identifier instead of subject id.   I did a simple test of re-running a loader job for a group with 2936 members where the loader job used subject identifier. Before it was taking 90-100 seconds. Now it takes less than 1 second.

It requires that you configure the sources.xml file to save the subject identifier into grouper's grouper_member table.  See https://bugs.internet2.edu/jira/browse/GRP-1381.

Thanks!

- Shilen

On 10/5/16, 12:16 PM, "Shilen Patel (JIRA)" <> wrote:

Shilen Patel created GRP-1381:
---------------------------------

             Summary: Use member table subject identifier in loader jobs to improve performance
                 Key: GRP-1381
                 URL: https://bugs.internet2.edu/jira/browse/GRP-1381
             Project: Grouper
          Issue Type: Bug
      Security Level: Standard (Standard bug, may impact functionality but does not represent a security vulnerability)
          Components: grouperLoader
            Reporter: Shilen Patel
            Assignee: Shilen Patel
             Fix For: 2.3.1, 2.3.0.patch






--
This message was sent by Atlassian JIRA
(v6.4.11#64026)




--
Jared Hoffman  Associate Director for Enterprise Infrastructure
Kenyon College LBIS    740.427.5948




--
Jared Hoffman  Associate Director for Enterprise Infrastructure
Kenyon College LBIS    740.427.5948




Archive powered by MHonArc 2.6.19.

Top of Page