High mem usage by ispcp-vrl-traff

[raphael]

Quote:Does the get_file() call above actually read the whole file into memory?

Yes it does.
Many of the engine scripts need to be reviewed, mainly because they contain some code that shouldn't be there at all (or they behave in an odd way).

Quote:can we change this to return a file pointer, and just work through requesting line by line

get_file is only a method which does all that, so it would be easier to read the file 'manually' line by line rather than calling a method just to get a file pointer.

Quote:I know this will probably be slower, but would be less on the memory usage, which seems to be the issue here...

probably, and yes. I think I'll make it read 20 lines at a glance, so it is more efficient.