Grouper Users - Open Discussion List

["Redman, Chad" <>]

Not sure if this will get past virus filters, but I'll give it a try.  -Chad

-----Original Message-----
From: Gettes, Michael [] 
Sent: Tuesday, April 09, 2019 2:42 PM
To: Black, Carey M. <>
Cc: Chris Hyzer <>; Redman, Chad <>; 

Subject: Re: [grouper-users] Grouper daily report... leaves me with 
questions....

+1 billion!  Would love to see Chad’s capability.

/mrg

> On Apr 9, 2019, at 1:02 PM, Black, Carey M. <> wrote:
> 
> Chad,
> 
> Code is always welcome here. :)
>       Post to a wiki, send github lnk, send a tar ball... your call. :)
> 
> Maybe the class could make its way into the core github project too?
>       Maybe a "grouper-misc/unsupported/" ... "examples"/"samples"/"useful 
> stuff you might want to modify and use" directory? :)
> 
> I could also see thing like this ending up there too...
>       
> https://urldefense.proofpoint.com/v2/url?u=https-3A__spaces.at.internet2.edu_display_Grouper_Grouper-2Bhook-2Bwhich-2Badds-2Blink-2Bto-2BUI&d=DwIGaQ&c=sJ6xIWYx-zLMB3EPkvcnVg&r=wEQWI9G4vDvpfmhpuO6yww&m=9ijvV2kg44vPGLCe-lBy1DeVKPApux9cNWe6ZYL0wWs&s=qf-McCwkO5YzYFdiUc0IEAyee8rxnKt-7BcbzG5BKUI&e=
> 
> -- 
> Carey Matthew 
> 
> 
> -----Original Message-----
> From: Hyzer, Chris <> 
> Sent: Tuesday, April 9, 2019 12:27 PM
> To: Redman, Chad <>; Black, Carey M. 
> <>; 
> Subject: RE: Grouper daily report... leaves me with questions....
> 
> Sounds like the beginning (or including ending) of a grouper report 
> enhancement 😊
> 
> -----Original Message-----
> From:  
> <> On Behalf Of Redman, Chad
> Sent: Tuesday, April 09, 2019 12:25 PM
> To: Black, Carey M. <>; 
> Subject: RE: [grouper-users] Grouper daily report... leaves me with 
> questions....
> 
> We did exactly that! We have a custom class we can call from the command 
> line, and schedule it to run daily.
> 
> It reports the following queries:
> 
> * Summary of jobs per day, job type, host, and status; totals or averages 
> for the numeric fields to spot trends
> * Last 50 memberships added (Date Added, Group, Member, Creator)
> * Last 15 groups created (Date Added, Group, Creator)
> * Last 10 stems created (Date Added, Stem, Creator)
> * Optional usdu results
> * System info and object counts:
>  - environment
>  - memberships
>  - groups
>  - members
>  - folders
> 
> 
> The last 50 memberships added currently includes indirect memberships which 
> is less useful. At some point we will change this to direct memberships.
> 
> These are the command line options:
> 
> usage: edu.unc.its.idm.grouper.sync.SyncRunner
> -d,--delete <arg>   After reporting, delete the report rows from the
>                     loader log table from this many days ago
> -e,--end <arg>      Number of days ago for report end
> -h,--help           Print this message
> -s,--start <arg>    Number of days ago for report start
> -u,--usdu           Report on invalid subject IDs
> 
> We run with options: --start 7 --end 0 --delete 90 --usdu
> 
> The usdu is probably overkill; it makes the job go from 2 minutes to 25 
> minutes.
> 
> The output is straight text, so we pipe it directly to mail to the IDM 
> group.
> 
> I can send you the source or post here if interested.
> 
> -Chad
> 
> 
> 
> 
> -----Original Message-----
> From:  
> [] On Behalf Of Black, Carey M.
> Sent: Tuesday, April 09, 2019 10:17 AM
> To: 
> Subject: [grouper-users] Grouper daily report... leaves me with 
> questions....
> 
> Does anyone use the Grouper daily report?
> 
> Every day I see things like this:
> 
> "
> ----------------
> WITHIN LAST DAY:
> ----------------
> new memberships:       2,502
> new groups:            70
> updated groups:        4
> new folders:           27
> "
> 
> And I am left wondering...
>       Which users were added to which groups on day "x"?
>       What are the new groups created on day "x"?
>       What groups were updated on day "x"? ( And what was updated about 
> them? )
>       What are the new Folders created on day "x"?
>       What memberships were added to existing groups on day "x"?
> 
> Has anyone worked out some SQL (or GSH scripts :) ) to dig around in the 
> DB/API and produce more detailed daily reports?
> 
> Same questions apply for the "LOADER SUMMARY WITHIN LAST DAY" and "LOADER 
> JOBS" sections too...
> 
> Maybe the upcoming "Reports" feature will provide a UI interface to run the 
> SQL reports, but the SQL is still needed. :)
> 
> -- 
> Carey Matthew

Attachment: LoaderLogReport.java
Description: LoaderLogReport.java