Shibboleth Developers

["Michael A. Grady" <>]

Log retention policies based on total size of logs alone seems an odd
policy to me. We think of those policies based on the number of days we
think we want for problem solving, balanced by wanting to get rid of many of
them as soon as feasible from a privacy/FOIA/subpoena perspective. We are
taking a new look at what the "sweet spot" of that balance should be,
but generally it comes down to a couple of weeks. (Size may impact -- more
in the past than current with the ease and cheapness of adding space -- 
causing 
one to retain for a shorter period or somehow condense the logs. That was an 
issue a few years ago with our core UIUC public web page access logs.)

So I'd argue a good default would represent 14 to 21 days worth of activity.

>Cc: Noah Levitt 
><>,
> 
>
>From: Walter Hoehn 
><>
>Subject: Re: shib origin ok, log files rolling over ok.....
>Date: Wed, 12 May 2004 10:07:34 -0500
>To: 
>
>X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on basie.internet2.edu
>X-Spam-Status: No, hits=0.0 required=6.0 tests=none autolearn=no version=2.63
>X-Spam-Level: 
>X-Loop: 
>
>List-Id: <shibboleth-dev.internet2.edu>
>List-Help: 
><mailto:?subject=help>
>List-Archive: <https://mail.internet2.edu/wws/arc/shibboleth-dev>
>
>We can make this whatever we want.  The point is to do something that 
>is reasonable for most production deployments.  Right now we keep 100MB 
>of logs.  I'm not sure where the sweet spot is, but I'd definitely want 
>more than 20 MB.  Anyone who has an opinion on this should speak up 
>before we release...
>
>-Walter
>
>
>On May 12, 2004, at 8:22 AM, 
>
> wrote:
>
>> At 3:19 PM -0500 5/10/04, Walter Hoehn wrote:
>>> Well, you can have any setup you want by manually configuring log4j. 
>>> The point of the logging auto-setup stuff isn't to have lots of 
>>> configuration options, log4j already has that, it is to handle the 
>>> generic case as close to out of the box as possible.
>>>
>>
>> any chance we could default this number to something like 10, or 14, 
>> instead of 50?
>>
>> ....OTOH, if this number is hardwired somewhere deep in the guts of 
>> log4j, forget it.......

 
--
Michael A. Grady                                217.244.1253 
Senior Technology Architect and Strategist      217.265.5635 fax
Manager, Integration and Software Engineering
Campus Information Technologies and Educational Services (CITES)
University of Illinois at Urbana-Champaign
Rm. 105, 2212 Fox Drive, Suite C, Champaign, IL 61820