high memory usage after 0:00u

[prale]

@2:43 it uses 262.31 MB RAM

lets see what happens at 3:00
I hope gzip instead of bzip2 helps, it was using about 88% cpu with bzip2

[prale]

@3:01

492.22 MB RAM is used :S
I know it is increased with 230MB by the backup now
(gzip affects cpu but not the memory, off course I'll prefer to keep the gzip setting)

When you say it's normal that unix is using al the RAM for caching, I'll believe you.
Let's hope the server is not going to swap too many when I move my sites from another server and the load goes up.
(Now I have just 2 very low traffic sites running for testing)

Thanks for helping me

[joximu]

Hi prale

you can read this (memory linux) on many places... :-)

advantage gzip: often faster, less cpu and maybe memory consumption -> less influence on a high system load
advantage bzip2: backups are smaller (mostly)

If you have customers with lots of movies etc (50GB of mpg) then the backup takes really long and is not that usefull...

you still can set a "nice -n19" in the cron file to give the backup commands less priority...

/J

[prale]

Thanx joximu!
I've read some pages about the memory issue.
Indeed it's normal.

Still a few days back I've noticed it used even swap memory after a few weeks running, but maybe it's using this for caching also.
Anyway I have 2GB swap available, I'll think and hope it won't run out of memory that fast.

I know now, it's only the backup compression that's increasing the cache.

With gzip compression it uses only 20% cpu, with bzip2 it was 88%.
I only have a 60GB disk, so I think I'm going to use the bzip2 again, since disk space is more important to me then cpu usage, and the high cpu usage is only temporary.

Also I think I want the backups at 0:00 again.

[joximu]

ok - it's your server.

I was very unhappy when the old ispcp-server here was doing its backups after 1 o'clock since it was very slow and gave alot of error 500 - until about 3 o clock...

Did you compare the sizes of the backups?
I's less than 10% difference in genreal - the far bigger difference in cpu consumption AND time bzip2 requires did convince me...

/J

[prale]

Actually I agree, and I'll keep the gzip.