Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] RabbitMq Routing

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] RabbitMq Routing


Chronological Thread 
  • From: Vivek Sachdeva <>
  • To: "Crawford, Jeffrey" <>
  • Cc: "Ruch,Jeff" <>, "Gettes, Michael" <>, Chris Hyzer <>, Julio Polo <>, "" <>
  • Subject: Re: [grouper-users] RabbitMq Routing
  • Date: Tue, 29 Jan 2019 21:11:01 -0800
  • Ironport-phdr: 9a23:4R7hYBDt77yhevdWAtt3UyQJP3N1i/DPJgcQr6AfoPdwSP37psmwAkXT6L1XgUPTWs2DsrQY07qQ6/iocFdDyK7JiGoFfp1IWk1NouQttCtkPvS4D1bmJuXhdS0wEZcKflZk+3amLRodQ56mNBXdrXKo8DEdBAj0OxZrKeTpAI7SiNm82/yv95HJbAhEmDmwbaluIBmqsA7cqtQYjYx+J6gr1xDHuGFIe+NYxWNpIVKcgRPx7dqu8ZBg7ipdpesv+9ZPXqvmcas4S6dYDCk9PGAu+MLrrxjDQhCR6XYaT24bjwBHAwnB7BH9Q5fxri73vfdz1SWGIcH7S60/VC+85Kl3VhDnlCYHNyY48G7JjMxwkLlbqw+lqxBm3oLYfJ2ZOP94c6jAf90VWHBBU95eWCxPAIyyb4UBAekcM+hGs4bwvEEBoQekCAS2GO/j1j1Fi3nr1qM6yeQhFgTG0RQvENIPrnTbstb1P7oPX++v0KbIzSjMYO1I2Tjn9YPFdQ4uoeuSXbJxb8re10ovFxjfgVqMqYzqIi2a1voXvGWA4OpgUPigi28jqw1rvjevwcIsh5DPi4kIxF7E8iB5z5w0Jd2+UEN7YcSrEZVKuCGbNot6WN0tTHx1uCoiz70GvoO0fCkEyJUn3RLQceGHc5SP4h77VOaRPSt4hGp8dL+xnRm96VCvyu3mWci6yllKrytFnsPSuX8Qyhzf8tCHSuF6/kem1zaPzwfT6uBCIUAoj6bUN5khwrsompoJr0vDES72mF7qjK+MbEok5umo6+PhYrn8o5+TLYl0hwfjOaotgsyyGfo0PwkSU2WZ/Om82r7u8lblTLhPgfA7kajUvZ/fKMgFuqK0BgpY34Us5huwCTqtzc4WkmMdLF1ffRKKl4jpNE/KIPD/Ffq/hk6jkDZvx/zfJ73hHojBImHMkbricrtw5FRQyAU0zdBY6JJUDq8OLOjvVU/2sdzUFh45MwqqzOb7ENhxyIITVX6ND6KcPqPfskSH6v4qLuSDZ4IYuTnwJv076/LyiHI0nFwQcKam0JcPbXC3BPVmI0GXYXr2hdcBFH8HsRQkTOz0iV2CTyBcZ3WpX60m+j47CJ+pApndRo+3m7GB0yK7EYdXZmBCEFyDDXDod4CcV/cWdC2SOtNhkiADVbW5RI8hzxautBLiy7V5NOrY4zAYtYn929hv/O3ejhUy9T1vD8SByGGBVWB0nmUURzAoxqB/p1Jyykud3aRinfNXCMFTtLt1VVJwHoTV0OJ9Edy2EiDMcNmTRUfsCoGkCis4Udw22dMmYlo7Bt6mh1bO0zf8UJEPkLneOp0q/6GU5HH6J8pw1X+OgKQ7kVg4T8hUPGamiqNh/iDcAofIlwOSkKP8JvdU5zLE6GrWlTnGh0pfSgMlFPydBX0=

Hi Jeffrey,

Are you planning to use queues or topics? If only queues, then everything is already implemented. If topics, then it's almost done. I just need to merge a branch into master and publish a patch.

Thanks,
Vivek


On Tue, Jan 29, 2019 at 6:29 PM Crawford, Jeffrey <> wrote:

Hi,

 

Did anything come of this? We have an upcoming project where if we could set up MQ subscription based on folder paths. We could lock down group message changes to specific queue access.

 

We don’t want apps to get group membership changes for groups they don’t have business seeing. However we would like to use a queue as the subscription endpoint for grouper data.

 

Does that make sense and is that what is being discussed here?

 

Thanks

Jeffrey C.

 

 

From: <> on behalf of "Ruch,Jeff" <>
Date: Sunday, December 30, 2018 at 4:27 PM
To: "Gettes, Michael" <>, Chris Hyzer <>
Cc: Julio Polo <>, Vivek Sachdeva <>, "" <>
Subject: Re: [grouper-users] RabbitMq Routing

 

Great News!!  Let me know when you are ready for me to test.

 

Jeff


From: Gettes, Michael <>
Sent: Saturday, December 29, 2018 9:03:22 PM
To: Chris Hyzer
Cc: Julio Polo; Ruch,Jeff; Vivek Sachdeva;
Subject: Re: [grouper-users] RabbitMq Routing

 

Wonderful news!  Vivek - THANK YOU!

 

A Happy and Healthy New Year to the entire Grouper Dev team and everyone else!

 

Thank you for all you do.

 

/mrg



On Dec 29, 2018, at 10:13 PM, Hyzer, Chris <> wrote:

 

Vivek has done most of this and as we reviewed it, we noticed that the Unicon part had spring _expression_ substitution, but Grouper generally uses EL which can do similar things.  I assume that’s not controversial to not add another way to configure expressions…  anyways, almost done with this…

 

Thanks

Chris

 

From: Julio Polo <> 
Sent: Wednesday, December 19, 2018 2:19 PM
To: Gettes, Michael <>
Cc: Ruch,Jeff <>; Vivek Sachdeva <>; Hyzer, Chris <>;
Subject: Re: [grouper-users] RabbitMq Routing

 

Hi Chris,

In case it helps (ie I implore you to implement this :-), here are the specs we gave to Unicon when we commissioned the work to publish Grouper messages to a topic exchange:

The JSON messages will be published to a RabbitMQ topic exchange. The message routing key will be based on the group ID path (a colon-­delimited path) and should be configurable in a properties files. This property will consist of one or more regular expressions, which when matched will lead to a substitution command that is applied to the matched group ID path. Colons should always be converted into a period, even if that is not specified in the substitution command. Here is an example using vi syntax:

s/^hawaii.edu:\(auto:sis:registration:.*\)(enrolled|waitlisted|withdrawn)$|group.modify./\1/

 so if group in message is:

  hawaii.edu:auto:sis:registration:MAN:MATH:100:123456:201410:enrolled

 the message routing key for the message would be:

  group.modify.auto.sis.registration.MAN.MATH.100.123456.201410

If no regular expressions are defined, simply substitute colons with periods.

If a JSON message has no group ID path associated with it, the properties file should allow us to use regular _expression_ as done above to map strings from the JSON message into a message routing key. For example:

s/"setAttribute"/attribute.set/


-julio

 

On Wed, Dec 19, 2018 at 7:27 AM Gettes, Michael <> wrote:

Please provide support (or continue the support) for sending directly to a topic exchange.  The grouper code does it now and so does the Hawaii code.  As you note, setting group name into the routing key will go a long way.

 

Chris, do you want me to dig up the email from a few months ago where this was all outlined or do you still have it?

 

/mrg

 

On Dec 19, 2018, at 12:16 PM, Ruch,Jeff <> wrote:

 

I believe if you can set the path of the group as the routing key, that is all that is needed.

 

You should then be able to use rabbitmq shovel to move the messages from the grouper configured queue to a topic exchange.  The topic exchange will allow the routing of messages based on the routing key.  It supports wildcard filtering as well.

 

Jeff

 

 

 


From: Vivek Sachdeva <>
Sent: Tuesday, December 18, 2018 9:35:53 PM
To: Hyzer, Chris
Cc: Gettes, Michael; Ruch,Jeff; 
Subject: Re: [grouper-users] RabbitMq Routing

 

Yes, routing key is already supported but adding group name is not there yet.

 

Thanks,

Vivek

 

On Tue, Dec 18, 2018 at 7:30 PM Hyzer, Chris <> wrote:

Vivek, isn’t this already in Grouper?  Or is the gap having the group name dynamically put in the message?  Let us know what is missing and we might be able to fix asap.

Thanks
Chris



-----Original Message-----
From:  <> On Behalf Of Gettes, Michael
Sent: Monday, December 17, 2018 12:51 PM
To: Jeff <>
Cc: 
Subject: Re: [grouper-users] RabbitMq Routing

The built-in to Grouper code doesn’t have this ability but the Hawaii code (they commissioned Unicon) does have the ability to pass the group name in the routing code.  I have requested the Unicon code be combined with the built-in code.  Not sure where all this stands as this was part of the request prior to TechEx regarding “what do people want”.

The Hawaii code I am referring to is at https://github.com/Unicon/grouper-amqp-esb-publisher

/mrg

> On Dec 17, 2018, at 12:38 PM, Jeff <> wrote:
> 
> 
> Hi,
> 
> I would like Grouper to publish to RabbitMQ queues based on Grouper folder
> path.  I believe this is supported in RabbitMQ using a topic exchange and
> routing keys.  Currently, Grouper publishes directly to a RabbitMQ queue. 
> 
> Is there a way to do this either through configuration, or through another
> approach?
> 
> Thanks,
> 
> Jeff Ruch
> Colorado State University

 




Archive powered by MHonArc 2.6.19.

Top of Page