Skip to Content.
Sympa Menu

grouper-users - RE: [grouper-users] Re: [tier-api] grouper rabbitmq messaging

Subject: Grouper Users - Open Discussion List

List archive

RE: [grouper-users] Re: [tier-api] grouper rabbitmq messaging


Chronological Thread 
  • From: "Hyzer, Chris" <>
  • To: "Waldbieser, Carl" <>
  • Cc: Julio Polo <>, TIER-API <>, grouper-users <>
  • Subject: RE: [grouper-users] Re: [tier-api] grouper rabbitmq messaging
  • Date: Tue, 12 Sep 2017 17:55:32 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Ironport-phdr: 9a23:gJU8ZhYzhjXVv1RMNeUl/b3/LSx+4OfEezUN459isYplN5qZpsy9YR7h7PlgxGXEQZ/co6odzbGH4+a4ASQp2tWoiDg6aptCVhsI2409vjcLJ4q7M3D9N+PgdCcgHc5PBxdP9nC/NlVJSo6lPwWB6nK94iQPFRrhKAF7Ovr6GpLIj8Swyuu+54Dfbx9GiTe5Yr5+Ngm6oRnMvcQKnIVuLbo8xAHUqXVSYeRWwm1oJVOXnxni48q74YBu/SdNtf8/7sBMSar1cbg2QrxeFzQmLns65Nb3uhnZTAuA/WUTX2MLmRdVGQfF7RX6XpDssivms+d2xSeXMdHqQb0yRD+v9LlgRgP2hygbNj456GDXhdJ2jKJHuxKquhhzz5fJbI2JKPZye6XQds4YS2VcRMZcTyxPDJ2hYYsTAeQPPuhYoIv8p1QSohWxChKhBP/0xTNUmnP6wbE23uYnHArb3AIgBdUOsHHModn7NqkTUeG0w7fSzTnbcvhbxzf96JLJchA6r/2HQLV9cc/NxkkvFwLEj0ufqZb+MjOUzeQCr3KX7/d4Ve2xjW4nrRt9rSayyccxk4TEgJ8exF7D9SV82ok1JNu4RVZ6Yd6iDJtfqTuaN41oTcM+XW1kojg1xaAbuZKjcygKyYgnxx7Ca/OcaYSH/hXjVOOJLTd/nnJqYq6whxKs/kS61uL8Ucy03VBXpSRGitnBrm4B2AbP5sSaT/Zx41qt1SuK2gDd5exIPVw4mK/ZJpE/zbM8iJ8evEHdEiPqhkn6lLKae0s49uSy7+nrf6/qqoGBO4JwkA3yL6Yjl825DO8lKAYBRXKb9v651LD7/U32XrFKjvoun6fBrJ3UItgXqrOgDwJI0Ikv9Q+zDzC939sGh3UHK09FeA6cgIjuJlHOJu33Ae2ng1S2lzdr2+7JMaH9ApXMKXjDlq3tfbFg605AzAozytdf55FOBr4dJ/LzX1f9tN3eDhAnLwy52/jrB89h2o8DXG+DH7KVPL7XvF+G6e8jP/WAaYoXtTnjJPUp+fvjgHonlVMBY6WlxZ4XZ2q5HvRiLUWZe33sgtIZHGcPogU+TOzriVycXj5JfHuyXrk86S0hBIK7FYfMWIatgLqb0CilA5JWe3hKCkqQHnfwa4WER/AMZTqOIs9gjDMET6GtRJU51RGvrwL6z7tnLvHI+i0Dq57vztl15+vPlR4s7zx0CdqS032TQ21ugGwHWiI21rhloUNh0leDzbR4g/tAGNxc/fNJVRo6NYbCwOxgEtzyRxnBccmTSFa9WdimBTAxTsktw98VfUpxAdSijhbf3yW0Gb8VkaKEBIAq/q7GwXf+Ott9mD760/xrsFAiTsFOOHarnOo33AHJA8SBx1qQk6qgdKkX9CrE+m6SwHaSsQdVXBMmAovfWnVKLGvHv9njogvpT6WvEv5vZg5Kyd+QJ7Fia8biy0heSfHlftnSfjTiyC+LGR+Uy+bUP8LRcGIH0XCYURBcng==
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

I think we could swing that...

So we want to be able to set a route key for an exchange, could be static, or
could be based on group name, and you could do some replaces like the unicon
one.

Anything else?

Is a routing key a rabbitmq specific thing or does aws and activemq have a
similar feature?

Thanks
Chris

-----Original Message-----
From: Waldbieser, Carl
[mailto:]

Sent: Tuesday, September 12, 2017 11:47 AM
To: Hyzer, Chris
<>
Cc: Julio Polo
<>;
TIER-API
<>;
grouper-users
<>
Subject: Re: [grouper-users] Re: [tier-api] grouper rabbitmq messaging

Chris,

The message is typically sent to an exchange rather than directly to a queue.
If the exchange uses routing keys at all, you need some way to apply a key.
There could be potentially a lot of different ways you might do this.

It might be nice if there was some kind of component you could plug in to
apply a route. In Julio's example that group-to-route mapping seems like a
valid way to do it.

The approach we took is different-- the initial message always has a route
key that looks like "ORIGIN.pds", where "ORIGIN" would be a tag unique to a
source system (e.g. "grouper") and "pds" is a tag for a component in our
pipeline that interprets messages from various sources, applies any
additional information to the messages, and applies a new route label based
on more complex routing rules.

In our case, the initial route label from Grouper would essentially be static.

Thanks,
Carl Waldbieser
ITS Systems Programmer
Lafayette College

----- Original Message -----
From: "Chris Hyzer"
<>
To: "Julio Polo"
<>
Cc: "TIER-API"
<>,
"grouper-users"
<>
Sent: Tuesday, September 12, 2017 9:19:56 AM
Subject: [grouper-users] Re: [tier-api] grouper rabbitmq messaging

So do you enable routing to that queue or it automatically sends to all group
queues or only if they exist?

________________________________
From: Julio Polo
<>
Sent: Tuesday, September 12, 2017 12:38:16 AM
To: Hyzer, Chris
Cc: TIER-API; grouper-users
Subject: Re: [tier-api] grouper rabbitmq messaging

Great to see that Grouper will natively support RabbitMQ. Can it support a
feature to map a groupName into a message routing key used when publishing
the message? This would make it easier for applications to get only the
messages they want.

For example, if the groupName in the JSON is
"student:registration:2017:fall:math:101", a default rule that replaces
colons with periods will automatically give me the message routing key
student.registration.2017.fall.math.101. If I only wanted to get messages
for MATH registration groups, I can set up a queue with this binding:
student.registration.#.math.#

This groupName-to-message-routing-key mapping is a feature that is currently
supported in the Grouper-RabbitMQ work that Unicon did for us:

https://github.com/Unicon/grouper-amqp-esb-publisher

# SpEL-based regex replacement definition. The chain of 'replaceFirst' method
calls will be applied to an extracted group name (String) at runtime
# See:
http://docs.oracle.com/javase/7/docs/api/java/lang/String.html#replaceFirst(java.lang.String,%20java.lang.String)
changeLog.consumer.esbAmqp.regexReplacementDefinition =
replaceFirst('^hawaii.edu:',
'group.modify.').replaceFirst('(:enrolled|:waitlisted|:withdrawn)$', '')
changeLog.consumer.esbAmqp.replaceRoutingKeyColonsWithPeriods = true

-julio


On Sun, Aug 6, 2017 at 11:39 PM, Hyzer, Chris
<<mailto:>>
wrote:

Making progress on Grouper RabbitMQ messaging.


https://spaces.internet2.edu/display/Grouper/Grouper+Messaging+with+RabbitMQ


Got the configuration ironed out, made a rabbitmq-connector tarball, theres a
patch and snapshot client release since it needed some things, and the
grouperInstaller will install this component.


Still kicking the tires here...


Thanks

Chris



Archive powered by MHonArc 2.6.19.

Top of Page