Skip to Content.
Sympa Menu

grouper-study - Re: Grouper Real-time Loader

Subject: grouper-study

List archive

Re: Grouper Real-time Loader


Chronological Thread 
  • From: Gail H Lift <>
  • To: "Coleman, Erik C" <>
  • Cc: "" <>
  • Subject: Re: Grouper Real-time Loader
  • Date: Tue, 28 Nov 2017 13:19:21 -0500
  • Arc-authentication-results: i=1; mx.umich.edu; iprev=pass policy.iprev=209.85.128.179 (mail-wr0-f179.google.com); spf=pass ; dkim=pass ; dmarc=pass ; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; d=umich.edu; s=arc-2017-08-04; t=1511893165; c=relaxed/relaxed; bh=3VUMHTypJjoj3qPnbSPwH2H1raXNFahGRbN5xjavgd8=; h=In-Reply-To:References:From:Date:Subject:To:Cc; b=01cAykFoulB3RNJNbEJdIDzA7JOWkC2uWuUDNOUXs3O8Pe/Je1821QNanzEDIY4MoL3nhq/8chDO2OwEDEzH2mmdcHJzN6PeLh5cnX30CsEiwHocxug+qMT7FO0o5Y1nEQnfohzXrSvykPCTI4jGTsxKeZiV6jFc69YMHo8mzBMy0bNQvgqqt1wkfqny0wOgl9zao3CAuoWyVzwXC5Vrzi1dOWssu5XH/Y2moG+utBZfhB+cJL8Rn4OvR3LdVtsVlQf2P3AVcyf3xIBXNNoK6sOWlb+HvAG7keqzdSVm6FFo67tBU5KvMbW2k3LW/xHoVCBZPX0VH5f6Swnl6XXxNw==
  • Arc-seal: i=1; a=rsa-sha256; d=umich.edu; s=arc-2017-08-04; t=1511893165; cv=none; b=1n9tgaUPL7yx8SmSNb0mOSFGevAHP1DHVXZNK0ZFgco9MGT0CXlKdf3GjWi8aiK2Ywa+gqZp89xlbLm6Ya5CMlUm4J8SutiekooJOdR8bovwWph7bc8nBDTwwB3e1ns4ZX0mcoHZzRFyo1zr00O5fTqLeNN/Z64Wp0hfRKXLKhYqLFQS8OnGh7vbGHk9ySJlF4mBrcMrvMbWG4HQwHVs+StcqYxxiU9xzMFFWM7MciiAWRdeGtzz3Yy3eu2MBTlLzvLUurB1UXZ+5IKbMIGmnDYEWv8XbBm30BuG/qk+eDXh1yEHvn1GzhESc4RqoBjxiSUhdqhNTEy0SvCh7YYjbQ==
  • Ironport-phdr: 9a23:d8vuox3IAPI2X91ksmDT+DRfVm0co7zxezQtwd8ZseISIvad9pjvdHbS+e9qxAeQG96Ku7Qc06L/iOPJYSQ4+5GPsXQPItRndiQuroEopTEmG9OPEkbhLfTnPGQQFcVGU0J5rTngaRAGUMnxaEfPrXKs8DUcBgvwNRZvJuTyB4Xek9m72/q89pDXYAhEniaxba9vJxiqsAvdsdUbj5F/Iagr0BvJpXVIe+VSxWx2IF+Yggjx6MSt8pN96ipco/0u+dJOXqX8ZKQ4UKdXDC86PGAv5c3krgfMQA2S7XYBSGoWkx5IAw/Y7BHmW5r6ryX3uvZh1CScIMb7S60/Vza/4KdxUBLniikHOT43/m/Ul8J+kr5UrQm7qBBj2YPZep2ZOOZ8c67bYNgURXBBXsFUVyFZA42zdYoPD+4cNuhasoLzoVoOrRWiBQKxA+7vxT9Ihnvt0K0n1uQhEB3J3Aw6E90QrXvUscz4OaEPWu67y6nIyC/Mb/JQ2Trl6YjIdAwhru+WXbJ2b8XR1VcjGxnbgVqNtIzoOS6e2OcVs2WD4edtVfijh3Mmpg1suDSj2Mchh4bTio4IyV3J9j11zJgpKdC8UkJ2Yt6pHIFNuy2ENIZ6WN4uTmNstSs817YIo4S0fDIQx5Qi3xPfa+KIc4yP4h/7SumRJS13hG57d72inhqy6kigyuz6Vsm131ZFtC9FktjWun8T2BzT8NaISuBm/ku7wzmDzQXT5ftFIUAwj6bbNpshwr8smZoTq0jMADL5mFjugK+XcEUr5PSo5vzpb7jmvJOQKo55hhzkPqgwmsGyDv40PhUNUmWY4ei80afs/Uz9QLVElP02lazZvYjGKsQAvq61GRRV0po+6xmiDzaqytsYnWMALFJYYBKIkZLpN0jQL/DiF/e/hE6skCxwyvDbO73hA4nCLnjZnLj/YLl99lZQyBAvwtBH+5JUFrYBLer8Wk/rs9zYEwc5PBKuw+r+E9V9yp4eVn+PA6KCNKPSsESI5v40I+WSfoMVuTD9K+Q76P70i382h0Mdcbez0ZQJdX+4A6cuH0LMK1HrhtoEGGFO9ickTe+ioxfKBTNYbF6zW6Y94DY6E8SrAZqVFa63h7nU8y66GtV2LkRHBEzERXjoc62ZXvYHaGSfLtI3wW9MbqSoV4J0jULmjwT90bcyduc=

Michigan also has an LDAP primary subject source, with affiliation-related person data changing throughout the day. We have the same concerns about prioritization and queueing of jobs. We are concerned about load, and whether jobs would be re-triggered multiple times while still running. This could also result in provisioning delays.

Our IAM system is event-driven. We could easily send changed subject data to grouper in real time.

This page:
says 
"Support for LDAP jobs is minimal right now.  If a message is added to the message queue for an LDAP job, a full sync is simply performed.  If you plan to use this feature and would like to see this improved, please contact the Grouper Team."

Perhaps we should make a joint request?


On Thu, Nov 16, 2017 at 10:34 AM, Coleman, Erik C <> wrote:

Bert was promoting the real-time loader in the last conference call, so I’m starting to play around with it. I see already that it is primarily designed for SQL loader jobs not LDAP jobs, but our primary subject source is LDAP-based.  What sort of options do I have for improving our automatic LDAP-based loader processes? We have hundreds of groups, several with up to 100K+ members, and we have a concern with the prioritization and queueing of jobs if we end up stacking a lot of these, or we have other departments on campus creating loader jobs for their groups.  We also sync these large groups to a downstream Active Directory OU as well.

 

Thanks for any tips!

 

Erik Coleman

University of Illinois at Urbana-Champaign

 

 

 

 




--

Gail H Lift
MCommunity, IAM-IIA, ITS, University of Michigan



Archive powered by MHonArc 2.6.19.

Top of Page