Skip to Content.
Sympa Menu

grouper-users - [grouper-users] RE: loader log is very chatty and full of lines of questionable value....

Subject: Grouper Users - Open Discussion List

List archive

[grouper-users] RE: loader log is very chatty and full of lines of questionable value....

Chronological Thread 
  • From: "Black, Carey M." <>
  • To: "Redman, Chad" <>, "" <>
  • Cc: "" <>
  • Subject: [grouper-users] RE: loader log is very chatty and full of lines of questionable value....
  • Date: Fri, 18 Aug 2017 20:32:26 +0000
  • Accept-language: en-US
  • Authentication-results: spf=pass (sender IP is;; dkim=none (message not signed) header.d=none;; dmarc=pass action=none;
  • Ironport-phdr: 9a23:m9j5tR0Dm0aBZs12smDT+DRfVm0co7zxezQtwd8ZsesXKvTxwZ3uMQTl6Ol3ixeRBMOAuqIC07KempujcFRI2YyGvnEGfc4EfD4+ouJSoTYdBtWYA1bwNv/gYn9yNs1DUFh44yPzahANS47xaFLIv3K98yMZFAnhOgppPOT1HZPZg9iq2+yo9ZDeZwZFiCChbb9uMR67sRjfus4KjIV4N60/0AHJonxGe+RXwWNnO1eelAvi68mz4ZBu7T1et+ou+MBcX6r6eb84TaFDAzQ9L281/szrugLdQgaJ+3ART38ZkhtMAwjC8RH6QpL8uTb0u+ZhxCWXO9D9QKsqUjq+8ahkVB7oiD8GNzEn9mHXltdwh79frB64uhBz35LYbISTOfFjfK3SYMkaSHJBUMhPSiJBHo2yYYgBD+UDPOZXs4bzqFQVoBuiHAmhAP/jxiNUinPo26AxzuQvERvB3AwlB98CvmnZrNHvO6gOUuC51LTDwCvZYPNMxzj86JXDfBc7rf2CQLl9dtHeyU01GAzZjVWcs5HpMy2b2+kWtGib9PdgWfixhGE6tgF8uz6izdoihInOg4Ia0FHE9SNhzYY6P924T1N7Yca6H5tKrS2VLZN2Qts6T2FsvyY6xbIGtoChfCQQ1pso2gPfZvqaeIaL+hLuTPudLSt3iX5/d7+yhQy+/Ee8xuHmS8W53lZHojJYntXStX0BzQHf58eGR/dn+kqs1iyD2gDP5u1cL0A7i6nWJ4Ikz7M1lpccrVjMHiHzlUnog6Kbd1gr9+2n5unnYLjrqJqROJNvhQ7lKKsjnNG0D/4iPQgURWeb/Pyx1L398k39R7VHluU4n7XevpzGK8kXv7C0DRZI3oo67BawFCmp3M4fnXkaMFJKYxWHj5XvO17TOvz4Fe2/g1OwkDh12//GIrzhApLLLnTZl7fhYKp960pbyAo0ztBT/Y5bCrYEIP7rW0/xssLXDgMhPgCp3+rqB89x24wcVG6VDaKVLLnevUKG6+8vO+WMYZUauDf5K/gr/f7uino5lEcGcqmtx5QYdHO4Eu57L0mHb3fhmdABEXwXvgYkUuPllUCCXSZJZ3muR6I8+i07CIW+AIfMXICth6GB3D+lEZ1Mf2xJF06DEWnzeoWAWvcMcz6SItR/njAeVLihTZMh2g+0tA/81bVnMvTY9jcGup3+ydh///fTmg0q9TxoE8Sd1HmAT25unmMPWj82xL5woVZkxleeyqh3neZYFcdI6vNNUwc6LoLcz/dkB9zoWwLBeMuJR0i8QtWgHz4xUsw9z8UQbElgBtXxxizEimCQDrMQnrrPTLc0+66Wlyz6J89x/GzL2KwoiXE7RMAJOGG70Oo3vQfJAJPRnl/cir2nb7803SjR+X2FwHbU+kxUTUQ4BarfWm0Ha1GTsM/0/FjqTrmyBK4hPxcbj8OON/0ZRMfuiAAMbvPqM9eaK0m4gWqhTTPOjPvYZo7jcGZbhX+GIE8fjkYe8WvQZlt2PTuov2+LVG8mLlnoeU65tLAm8H4=
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99


Thanks for the insights.

I will enable the two " [Config | Type ] "
settings and see if those are more helpful.

My heartburn is that I think the other lines ( non ' session: start' ) are
useful. But I appear to have to take 4 "bad lines" to get 1 "good one". (
Not a great trade off. And not clear as to why that is the current, default,
So I hate to lose the good to get rid of the bad. ( But it looks like I need
to do that just to keep from filling up disks. :) )

Maybe the classes you pointed at will give me similar insights to what the
loader is or is not doing.
Thanks again. ( I am still finding my way through the configuration and
tuning. I have a feeling that this will take a bit of time to polish....)

Carey Matthew

-----Original Message-----
From: Redman, Chad

Sent: Friday, August 18, 2017 2:55 PM
To: Black, Carey M.


Subject: RE: loader log is very chatty and full of lines of questionable

The default has:

## Grouper Event Logging
## * Logs at _info_ only = INFO,

We took that out for our loader. The log4j settings we currently have on our
loader server are:

log4j.appender.R = org.apache.log4j.FileAppender
log4j.appender.R.File = ${log4j.filename.sync}
log4j.appender.R.layout = org.apache.log4j.PatternLayout
log4j.appender.R.layout.ConversionPattern = %d{ISO8601}: [%t] %-5p
%C{1}.%M(%L) - %m%n

log4j.rootLogger = WARN, R

## All Internet2 (warn to grouper_error per default logger) = WARN = INFO =

The GrouperLoaderType DEBUG setting is pretty useful for summarizing some of
the actual loader actions. The GrouperLoaderConfig DEBUG doesn't print out
very much, just the LDAP settings periodically.

Maybe the EventLog logging of session starts can be changed to print at level
debug instead of info? For a while, we had kept the level at info only in the
UI, because there was no other way to see who was logging in. But we
eventually turned it off in the UI as well, being too verbose.


-----Original Message-----

On Behalf Of Black, Carey M.
Sent: Friday, August 18, 2017 2:14 PM


Subject: [grouper-dev] RE: loader log is very chatty and full of lines of
questionable value....


I am seeing 1G log files created per day.
4721929 lines that have ' session: start'
1153101 lines that do not.

That is 4.7M lines of logs that end up in our splunk system that provide no
known useful information.

Does anyone else see this on their systems?
Does anyone use the Grouper Loader process?

Any hints about how to make the logging better? ( Other than track down the
line of code and wrapper it with an if block. )

Carey Matthew

-----Original Message-----

On Behalf Of Black, Carey M.
Sent: Wednesday, August 16, 2017 2:57 PM

Subject: [grouper-users] loader log is very chatty and full of lines of
questionable value....

I am trying to use the Loader process to sync some data into grouper from
LDAP. ( That part is working as far as I can tell after I gave it enough ram
to not fall over. :) )

However, in the grouper_error.log (for where the loader is logging) I am
seeing a lot of lines like :
2017-08-16 14:25:04,783: [DefaultQuartzScheduler_Worker-7] INFO - - [9a3e8...c35b,'GrouperSystem','application'] session:
start (0ms) "

And by a lot I mean ( Just from today's file...):

$ wc -l grouper_error.log ; grep -c ' session: start' grouper_error.log; grep
-vc ' session: start' grouper_error.log;
3135034 grouper_error.log ( Total lines in the file)
2379686 ( Lines that are ' session: start' lines, 75% of the file!)
755517 ( Lines that are not ' session: start' lines )

Can anyone tell me how to suppress ONLY those lines?
I might be wrong but other lines that say things like "add member" ,
"delete member" (etc...) look like they are being logged from the same
location. [ AKA: " INFO" ]

Could any explain why those log statements are there?
I really don't understand what they are trying to communicate.

Carey Matthew

Archive powered by MHonArc 2.6.19.

Top of Page