Grouper Users - Open Discussion List

["Gettes, Michael" <>]

Hi Richard,

Here are my configs… I hope this helps.

grouper.client.properties

grouper.messaging.system.rabbitmqSystem.name = rabbitmqSystem
grouper.messaging.system.rabbitmqSystem.class = 
edu.internet2.middleware.grouperMessagingRabbitmq.GrouperMessagingRabbitmqSystem
grouper.messaging.system.rabbitmqSystem.host = HOSTNAME.edu
grouper.messaging.system.rabbitmqSystem.virtualhost = /
grouper.messaging.system.rabbitmqSystem.port = 5672
grouper.messaging.system.rabbitmqSystem.defaultPageSize = 800
grouper.messaging.system.rabbitmqSystem.maxPageSize = 1000
grouper.messaging.system.rabbitmqSystem.username = grouper
grouper.messaging.system.rabbitmqSystem.password = XXXXX

— pay attention to username vs. user

grouper-loader.properties

changeLog.consumer.rabbit.quartzCron = 2/10 * * * * ?                         
                                 
changeLog.consumer.rabbit.class = 
edu.internet2.middleware.grouper.changeLog.esb.consumer.EsbConsumer
changeLog.consumer.rabbit.publisher.class = 
edu.internet2.middleware.grouper.changeLog.esb.consumer.EsbMessagingPublisher
changeLog.consumer.rabbit.publisher.messagingSystemName = rabbitmqSystem
changeLog.consumer.rabbit.publisher.queueOrTopicName = amq.topic
changeLog.consumer.rabbit.publisher.messageQueueType = topic
changeLog.consumer.rabbit.publisher.exchangeType = topic
changeLog.consumer.rabbit.regexRoutingKeyReplacementDefinition = 
${groupName.replaceAll(":", ".”)}

i send everything to a topic (amq.topic) and there i route messages based on 
the group name as the routing key.  remember, group names are translated from 
a:b:c to a.b.c and # is wild-carding.  Yes, I am aggressive with running it 
every 10 seconds.

I see message transmission rates as high as 30K per minute (500/sec).

/mrg

> On Apr 23, 2019, at 2:43 PM, Richard Frovarp <> 
> wrote:
> 
> I'm running into an error trying to use RabbitMQ with 2.4.
> 
> Following:
> 
> https://urldefense.proofpoint.com/v2/url?u=https-3A__spaces.at.internet2.edu_display_Grouper_Grouper-2BMessaging-2Bwith-2BRabbitMQ&d=DwIGaQ&c=sJ6xIWYx-zLMB3EPkvcnVg&r=wEQWI9G4vDvpfmhpuO6yww&m=hurczbcdGFQyVjfsBTbJoskCtuiNd89Mukv3HDFOQj0&s=0yISCW_grUEPnJ4Q8oUm1yQ2o9CZwQi7BHeORTsaa1I&e=
> 
> So I've updated grouper-loader.properties. It first complained about a 
> missing cron, so I added that. I then copied this:
> 
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Internet2_grouper_blob_master_grouper-2Dmisc_grouper-2Dmessaging-2Drabbitmq_src_main_resources_grouper.client.rabbitMq.example.properties&d=DwIGaQ&c=sJ6xIWYx-zLMB3EPkvcnVg&r=wEQWI9G4vDvpfmhpuO6yww&m=hurczbcdGFQyVjfsBTbJoskCtuiNd89Mukv3HDFOQj0&s=Dl2BqBBG9hNWTmyPvZzejfDg5g_8_yF65C0pfOIUdB4&e=
> 
> into
> 
> /opt/grouper/grouper.apiBinary-2.4.0/conf/grouper.client.properties
> 
> swapping out my connection details. I then run the daemon and get this:
> 
> 2019-04-23 13:36:00,700: [DefaultQuartzScheduler_Worker-3] ERROR 
> EsbConsumer.processChangeLogEntries(659) -  - problem
> java.lang.NullPointerException: Cant find config for messageSystemName: 
> 'rabbitmq'
>         at 
> edu.internet2.middleware.grouperClient.messaging.GrouperMessagingEngine.retrieveGrouperMessageSystem(GrouperMessagingEngine.java:91)
>         at 
> edu.internet2.middleware.grouperClient.messaging.GrouperMessagingEngine.send(GrouperMessagingEngine.java:58)
>         at 
> edu.internet2.middleware.grouper.changeLog.esb.consumer.EsbMessagingPublisher.dispatchEvent(EsbMessagingPublisher.java:72)
>         at 
> edu.internet2.middleware.grouper.changeLog.esb.consumer.EsbConsumer.processChangeLogEntries(EsbConsumer.java:629)
>         at 
> edu.internet2.middleware.grouper.changeLog.ChangeLogHelper.processRecords(ChangeLogHelper.java:245)
>         at 
> edu.internet2.middleware.grouper.app.loader.GrouperLoaderType$5.runJob(GrouperLoaderType.java:638)
>         at 
> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.runJob(GrouperLoaderJob.java:465)
>         at 
> edu.internet2.middleware.grouper.app.loader.GrouperLoaderJob.execute(GrouperLoaderJob.java:345)
>         at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
>         at 
> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
> 
> I'm rather confused as to what isn't lining up. I've changed the 
> changeLog.consumer.rabbitMqMessagingSample.publisher.messagingSystemName 
> = rabbitmq
>  to something completely different in the grouper-loader.properties 
> file, that changes the name of what it can't find. I understand it not 
> finding something bogus, but not sure why it can't find something in 
> grouper.client.properties.
> 
> Thanks,
> 
> Richard