Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] RabbitMq Routing

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] RabbitMq Routing


Chronological Thread 
  • From: "Ruch,Jeff" <>
  • To: "Gettes, Michael" <>, Chris Hyzer <>
  • Cc: Julio Polo <>, Vivek Sachdeva <>, "" <>
  • Subject: Re: [grouper-users] RabbitMq Routing
  • Date: Mon, 31 Dec 2018 00:26:50 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Ironport-phdr: 9a23:VfRIfB+SguzR2P9uRHKM819IXTAuvvDOBiVQ1KB+0usUIJqq85mqBkHD//Il1AaPAd2Lraocw8Pt8InYEVQa5piAtH1QOLdtbDQizfssogo7HcSeAlf6JvO5JwYzHcBFSUM3tyrjaRsdF8nxfUDdrWOv5jAOBBr/KRB1JuPoEYLOksi7ze+/94HQbglSmDaxfa55IQmrownWqsQYm5ZpJLwryhvOrHtIeuBWyn1tKFmOgRvy5dq+8YB6/ShItP0v68BPUaPhf6QlVrNYFygpM3o05MLwqxbOSxaE62YGXWUXlhpIBBXF7A3/U5zsvCb2qvZx1S+HNsDtU7s6RSqt4LtqSB/wiScIKTg58H3MisdtiK5XuQ+tqwBjz4LRZoyeKfhwcb7Hfd4CRWRPQNtfVzBPDI2/YYsADesBMvpXoITmvVQCsQeyCBOwCO/zyDJFgGL9060g0+QmFAHLxAIsEc4TsHvIrNX5LKMcXv67zKnGwznIcvRb1zPj54jGfBAtu+2CXa9sfsrR0kQgCwTFjlGXqYz+IzOazPgNvHaB4+V+SO2vlncqpgdsqTahwccsj5PGhoMTyl3c9SV22og0Kse5SE56e9KrDoZftzyCO4tzRcMtXmBouCg6y7Eco5G7YTQKyJM/yx7fd/yHb5CI7gvtWemLOTh3nHJld6ixhhmo8Eigy/fwWdep31ZXtiZFisPMtncK1xzd8siHTfp9/kG92TqVyw/T7eRELVgulaXFJJ4hw6UwloYJsUvZAi/2mUL2jKmMekUh4Oeo7eLqaajlqJ+EL4J5hR3yPr4zlsCjA+k0KAkDUmuB9emz1bDv5U/0TbVQgvErk6TUsYrWKdkUq6O5GQNY1pov5w6xDzi409kUgXwKIVdFdR+ElYfkOlTDL+7lAvqxgVmhlSlnyvDCM7DhB5jCMHvOnbPucLt79kVS0hA8zcpF6JJRErwBIOz8Wkv2tNHAFhE0Lwu6z/roBdlky44QQWyCDraeMKzJr1CE/OUvI/SQZIAOvzb9Nv4l6OP0gX8hg18derWp0oULZ3CkH/RmJEOZbWDrgtccDWcKug0+TOvpiFGYTTFTYHOyU7o95jE9Fo2mEZ/OS4+xjLCbwSu3Ap9banpHB12PC3vleISJV+8JaC2II89hljIEVaKmS48kzRygsBH1y7RpLubO5iMYqI7s1Nhu6uLPkhEy8Tt0D9+B026XU2F7gHkESCEr06BiuUB90EuM0bBkg/xEEtxe//xJUh09NZ7B1+x1FcryVhvcfteSVlmmWM6mDCo1TtIw2N8Of119F8u4ghDC2SqqH6Eal6aNBJMq7qLQwWL9KNhgxHbbh+EdiAxsbcZTKWC9wuZa9gPTDoPN2Q3NmKu2aakH9DPD8CGOwXfY+AlzUBRxSu3lTGISfAOCqN/591HPVZevEr9hLxNMz8jEJ6dXPI7Hl1JDEb3ZJd/eJ0C8lWn6TUKqy72CKrD3cGU11yLZD1MYmhweu3uKKF5tVW+av2vCAWk2RhrUaET2/Lw78SvjFBVmxhyWb0Bny7u+8wIUgvrZUf4Iw7YYo3l/+S5sEgO72NTbQ5qbqgxtcb8UQOt14UwPlAe7/xd4IoTmKqljglAEdAEinU7g2VNNF45AucMtqHQx0ANuJOSV3E4SPz4=
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

Great News!!  Let me know when you are ready for me to test.


Jeff


From: Gettes, Michael <>
Sent: Saturday, December 29, 2018 9:03:22 PM
To: Chris Hyzer
Cc: Julio Polo; Ruch,Jeff; Vivek Sachdeva;
Subject: Re: [grouper-users] RabbitMq Routing
 
Wonderful news!  Vivek - THANK YOU!

A Happy and Healthy New Year to the entire Grouper Dev team and everyone else!

Thank you for all you do.

/mrg

On Dec 29, 2018, at 10:13 PM, Hyzer, Chris <> wrote:

Vivek has done most of this and as we reviewed it, we noticed that the Unicon part had spring _expression_ substitution, but Grouper generally uses EL which can do similar things.  I assume that’s not controversial to not add another way to configure expressions…  anyways, almost done with this…
 
Thanks
Chris
 
From: Julio Polo <> 
Sent: Wednesday, December 19, 2018 2:19 PM
To: Gettes, Michael <>
Cc: Ruch,Jeff <>; Vivek Sachdeva <>; Hyzer, Chris <>;
Subject: Re: [grouper-users] RabbitMq Routing
 
Hi Chris,

In case it helps (ie I implore you to implement this :-), here are the specs we gave to Unicon when we commissioned the work to publish Grouper messages to a topic exchange:

The JSON messages will be published to a RabbitMQ topic exchange. The message routing key will be based on the group ID path (a colon-­delimited path) and should be configurable in a properties files. This property will consist of one or more regular expressions, which when matched will lead to a substitution command that is applied to the matched group ID path. Colons should always be converted into a period, even if that is not specified in the substitution command. Here is an example using vi syntax:

s/^hawaii.edu:\(auto:sis:registration:.*\)(enrolled|waitlisted|withdrawn)$|group.modify./\1/

 so if group in message is:

  hawaii.edu:auto:sis:registration:MAN:MATH:100:123456:201410:enrolled

 the message routing key for the message would be:

  group.modify.auto.sis.registration.MAN.MATH.100.123456.201410

If no regular expressions are defined, simply substitute colons with periods.

If a JSON message has no group ID path associated with it, the properties file should allow us to use regular _expression_ as done above to map strings from the JSON message into a message routing key. For example:

s/"setAttribute"/attribute.set/

-julio
 
On Wed, Dec 19, 2018 at 7:27 AM Gettes, Michael <> wrote:
Please provide support (or continue the support) for sending directly to a topic exchange.  The grouper code does it now and so does the Hawaii code.  As you note, setting group name into the routing key will go a long way.
 
Chris, do you want me to dig up the email from a few months ago where this was all outlined or do you still have it?
 
/mrg


On Dec 19, 2018, at 12:16 PM, Ruch,Jeff <> wrote:
 
I believe if you can set the path of the group as the routing key, that is all that is needed.
 
You should then be able to use rabbitmq shovel to move the messages from the grouper configured queue to a topic exchange.  The topic exchange will allow the routing of messages based on the routing key.  It supports wildcard filtering as well.
 
Jeff
 
 
 

From: Vivek Sachdeva <>
Sent: Tuesday, December 18, 2018 9:35:53 PM
To: Hyzer, Chris
Cc: Gettes, Michael; Ruch,Jeff; 
Subject: Re: [grouper-users] RabbitMq Routing
 
Yes, routing key is already supported but adding group name is not there yet.
 
Thanks,
Vivek
 
On Tue, Dec 18, 2018 at 7:30 PM Hyzer, Chris <> wrote:
Vivek, isn’t this already in Grouper?  Or is the gap having the group name dynamically put in the message?  Let us know what is missing and we might be able to fix asap.

Thanks
Chris



-----Original Message-----
From:  <> On Behalf Of Gettes, Michael
Sent: Monday, December 17, 2018 12:51 PM
To: Jeff <>
Cc: 
Subject: Re: [grouper-users] RabbitMq Routing

The built-in to Grouper code doesn’t have this ability but the Hawaii code (they commissioned Unicon) does have the ability to pass the group name in the routing code.  I have requested the Unicon code be combined with the built-in code.  Not sure where all this stands as this was part of the request prior to TechEx regarding “what do people want”.

The Hawaii code I am referring to is at https://github.com/Unicon/grouper-amqp-esb-publisher

/mrg

> On Dec 17, 2018, at 12:38 PM, Jeff <> wrote:
> 
> 
> Hi,
> 
> I would like Grouper to publish to RabbitMQ queues based on Grouper folder
> path.  I believe this is supported in RabbitMQ using a topic exchange and
> routing keys.  Currently, Grouper publishes directly to a RabbitMQ queue. 
> 
> Is there a way to do this either through configuration, or through another
> approach?
> 
> Thanks,
> 
> Jeff Ruch
> Colorado State University




Archive powered by MHonArc 2.6.19.

Top of Page