Grouper Users - Open Discussion List

["Gettes, Michael" <>]

Over the last several weeks I have been doing a bit of testing and demo using 
the TIER grouper package.  Through this effort (and based on my prior 
experiences with Grouper) I needed to be able to better “see" what was going 
on.  I offer up these 2 bits of SQL.  I am using mySQL (MariaDB from centos 
as packaged by TIER) and a separate instance of MariaDB v10 as the grouper 
DB. (I have two TIER/grouper instances on my laptop).

Overall, I recommend setting changeLog.changeLogConsumerBatchSize = 100 (or 
50) in grouper-loader.properties which helps with the updating of information 
of where the consumers are at which helps with both SQL queries.  Chris, is 
there something that influences the BatchSize for the temp changelog which 
appears to be 1000?  I couldn’t seem to locate it.  Also, how can I tell 
where in processing is the tempChangelog consumer - like how many to go?

The first is tiny and shows the consumers and where they are in processing.  
When they last ran (timestamp and age) and how many entries to go to be all 
caught up.  For me, this takes about 3-5ms to run.  This might also be useful 
from a monitoring perspective - maybe send notices over certain thresholds 
for certain consumers when so “old” and connected to Nagios and such.

The second is similar to what Chris installed in the latest grouper under 
Miscellaneous >> loader jobs which I had shared as part of the Grouper 
Deployment Guide work.  Chris has broken it out on a per loader job basis 
which is definitely useful.  But, for me, from an operations perspective, you 
lose the larger view.  There’s more than just those specific loader jobs.  
This SQL shows what’s going on and if you run it like every 10 seconds (like 
the first can be run) you start to see how things change and the behavior of 
grouper itself.  It tries to thin out the noise of grouper consumers but show 
the real activity.

I hope others find these useful and maybe Chris and crew would consider some 
sort of ops display (auto-updating) of what’s happening with grouper.

And, for the record, anyone who says grouper isn’t so useful or the code is 
bad or whatever - well, they just don’t know what they’re talking about.  
Grouper can be the basis of change for any IT org let alone a 
college/University.  No software is perfect but Grouper definitely addresses 
many issues in Higher Ed.  You just have to dive in.  I, for one, very much 
appreciate Chris, Shilen, Bert (and I am sure there are others and I don’t 
know who you are but please don’t be insulted if I am not listing you).  You 
guys do great stuff.  THANK YOU!  (Looking forward to 2.4).  Also, a 
shout-out to Hubing, Caskey, Gasper, Jokl and whomever else is involved in 
the TIER packaging.  You guys also rock!  The combination of all this makes 
figuring things out fun… especially when you don’t have the resources to get 
it done - but, that’s another story!

The Grouper-Consumers SQL generates something like the attached image.  The 
Grouper-Loader-ops.sql is a bit more involved in what it displays so you just 
have to run it.  Both of these are simple queries - nothing is modified.  And 
if you’re interested, I use DBeaver-CE as my SQL tool of choice.

Attachment: Grouper-Consumers.sql
Description: Grouper-Consumers.sql

Attachment: Grouper-Loader-ops.sql
Description: Grouper-Loader-ops.sql

Attachment: PastedGraphic-1.png
Description: PastedGraphic-1.png