How to deal with log storage/rotation

[aseques]

(05-30-2011 09:58 PM)kilburn Wrote:  Beware that this can impose a performance penalty on servers with a high number of domains. Basically, after running for a full year, such a server will have 365*n_domains files in a single folder. Therefore, anything that tries to scan such a folder is going to impose a huge number of io operations to the disk.

For instance, on a server with 100 domains, this means that performing an "ls -l" inside this directory will generate 36500 io operations. Considering that a typical 7200rpm hdd can perform approximately 90iops, this means that the disk will be saturated for almost 7 full minutes. Using the past configuration, the same problem exists but it is 7 times softer (weekly logs instead of daily logs = 7 times less files).

That's certainly true, maybe this could go together with a script to archive somewhere else the past month logs launched monthly by crontab.
In my experience it's really a pain having to walk around trying to find when something happened and it's a real advantage having the day for the logs.
What do you thing about creating the script, it's quite easy to do.