Skip to Content.
Sympa Menu

grouper-users - [grouper-users] RE: loader log is very chatty and full of lines of questionable value....

Subject: Grouper Users - Open Discussion List

List archive

[grouper-users] RE: loader log is very chatty and full of lines of questionable value....


Chronological Thread 
  • From: "Redman, Chad" <>
  • To: "Black, Carey M." <>, "" <>
  • Cc: "" <>
  • Subject: [grouper-users] RE: loader log is very chatty and full of lines of questionable value....
  • Date: Fri, 18 Aug 2017 18:54:42 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Ironport-phdr: 9a23:Zrx+CxJVBWQFmIdK79mcpTZWNBhigK39O0sv0rFitYgXKvX9rarrMEGX3/hxlliBBdydsKMUzbKO+4nbGkU4qa6bt34DdJEeHzQksu4x2zIaPcieFEfgJ+TrZSFpVO5LVVti4m3peRMNQJW2aFLduGC94iAPERvjKwV1Ov71GonPhMiryuy+4ZPebgFLiTanfb9+MAi9oBnMuMURnYZsMLs6xAHTontPdeRWxGdoKkyWkh3h+Mq+/4Nt/jpJtf45+MFOTav1f6IjTbxFFzsmKHw65NfqtRbYUwSC4GYXX3gMnRpJBwjF6wz6Xov0vyDnuOdxxDWWMMvrRr0vRz+s87lkRwPpiCcfNj427mfXitBrjKlGpB6tvgFzz5LIbI2QMvd1Y6HTcs4ARWdZXshfSTFPAp+yYYUMAeoOP+dYoJXyqVQBtha+GRCsCP/zxjNUmnP6w6s32PkhHwHc2wwgGsoDvHrIotrrKagSVPq6zK/QwT7ecf5W2S3y55XGfhs8pvyDQbJwftDMxkY3DQPKkEifqYn/MDOTzekNrm6b4PZ6We2xlmEnthh8rz6yzckijYnJg5gaylHC9Shhz4Y1P9q4SFNjYdG6CptcrTuVN5NuQs86R2Fovyk6yrIYtp6hZiQF1okoxwPZZveacIaI+gruWPiLLjtkmX5ofa+ziwuv/UWlxO3xWdW43EpPoypLjNbBuWoC2hnW58WGVPdx4F+t1SuP2gzN8O1IP045mbDZJpI73LI9locfvELeFSHsgkr2lrWZdkA89+io9evnZrLmq4eEOYJojQ/yLqojltWiDOs6LAQCRm+b9v+i27H5+k35XalKgeYxkqnEtpDVON4XprajAw9SzoYs9QqwDyun0NQfm3kLNlVFeA+bj4jtPFHOJ/P4Ae2jjFSrlTdn3/HGPrv/DZXRNnXPjq3ucapg50NZ1QY/0M1T6pdaCrwOPP7/Rkr8tNLGARI2KQO5xuPqBdRj2o8AQW6PB7WWMKLWsV+G/OIvJOyMaZcJtzb9Mfcq+ubhjWUnllAAeKmmx50XZWulHvRgP0qVe2TjjcocEWsSpAoxUPTqiEGeUT5Uf3uyULg85jYmCIK+E4jDXJmhgKGa3CilBJ1WfXtLClSNEXfza4WEQOkAZDiTIs9njjwLS6KhS4k/2hGyqgP20aRoIffJ+icAr5LsyMB15/HPlRE17TF0AN6d02aQT2FsgGwIXSY6071hrkxj0VqD1al4g+dEFdxI+f9FSAY6NZjAz+NkEdDyXBzOfsuXRFq8XNqpHCwxHZoNxIpESUJ0ENbmxjvKxSe7S5pT3fTfDpg9+aGahiKqD8Fm1jDL2LR3yxFsTdFIKHWrnOti7AXJHKbIlVmUjaCnaf5a0SLQvi/XwnCJoVlVSkttSqjfRlgeYFfbt9L0+hmEQrOzX+cJKAxEnIS4J6dPY9utxX5GTfupcIDVY2u9rH29CROBwJuRaoGsdmkAinaOQHMYmhweqC7VfTM1AT2s9ieHVGRj
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

The default log4.properties has:

## Grouper Event Logging
## * Logs at _info_ only
log4j.logger.edu.internet2.middleware.grouper.log.EventLog = INFO,
grouper_event

We took that out for our loader. The log4j settings we currently have on our
loader server are:

--------------------------
log4j.appender.R = org.apache.log4j.FileAppender
log4j.appender.R.File = ${log4j.filename.sync}
log4j.appender.R.layout = org.apache.log4j.PatternLayout
log4j.appender.R.layout.ConversionPattern = %d{ISO8601}: [%t] %-5p
%C{1}.%M(%L) - %m%n

log4j.rootLogger = WARN, R

## All Internet2 (warn to grouper_error per default logger)
log4j.logger.edu.internet2.middleware = WARN

log4j.logger.edu.internet2.middleware.grouper.RegistryInstall = INFO
log4j.logger.edu.internet2.middleware.grouper.app.loader.GrouperLoaderType =
DEBUG
log4j.logger.edu.internet2.middleware.grouper.app.loader.GrouperLoaderConfig
= DEBUG
--------------------------

The GrouperLoaderType DEBUG setting is pretty useful for summarizing some of
the actual loader actions. The GrouperLoaderConfig DEBUG doesn't print out
very much, just the LDAP settings periodically.

Maybe the EventLog logging of session starts can be changed to print at level
debug instead of info? For a while, we had kept the level at info only in the
UI, because there was no other way to see who was logging in. But we
eventually turned it off in the UI as well, being too verbose.

-Chad




-----Original Message-----
From:


[mailto:]
On Behalf Of Black, Carey M.
Sent: Friday, August 18, 2017 2:14 PM
To:

Cc:

Subject: [grouper-dev] RE: loader log is very chatty and full of lines of
questionable value....

Bump.

I am seeing 1G log files created per day.
4721929 lines that have ' session: start'
1153101 lines that do not.

That is 4.7M lines of logs that end up in our splunk system that provide no
known useful information.

Does anyone else see this on their systems?
Does anyone use the Grouper Loader process?

Any hints about how to make the logging better? ( Other than track down the
line of code and wrapper it with an if block. )

--
Carey Matthew



-----Original Message-----
From:


[mailto:]
On Behalf Of Black, Carey M.
Sent: Wednesday, August 16, 2017 2:57 PM
To:

Subject: [grouper-users] loader log is very chatty and full of lines of
questionable value....

I am trying to use the Loader process to sync some data into grouper from
LDAP. ( That part is working as far as I can tell after I gave it enough ram
to not fall over. :) )


However, in the grouper_error.log (for where the loader is logging) I am
seeing a lot of lines like :
"
2017-08-16 14:25:04,783: [DefaultQuartzScheduler_Worker-7] INFO
EventLog.info(156) - - [9a3e8...c35b,'GrouperSystem','application'] session:
start (0ms) "

And by a lot I mean ( Just from today's file...):

$ wc -l grouper_error.log ; grep -c ' session: start' grouper_error.log; grep
-vc ' session: start' grouper_error.log;
3135034 grouper_error.log ( Total lines in the file)
2379686 ( Lines that are ' session: start' lines, 75% of the file!)
755517 ( Lines that are not ' session: start' lines )

Can anyone tell me how to suppress ONLY those lines?
I might be wrong but other lines that say things like "add member" ,
"delete member" (etc...) look like they are being logged from the same
location. [ AKA: " INFO EventLog.info(156)" ]

Could any explain why those log statements are there?
I really don't understand what they are trying to communicate.

--
Carey Matthew






Archive powered by MHonArc 2.6.19.

Top of Page