Re: Re: [squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

Hello,

I just wanted to report back the last tests:

After the memory cache is filled to 100% the squid (3.1.4 or 3.1.3)
still needs more memory over time when under load, about 1-2 GB a day.
memory_pool off did not change anything, the process size still rises.
The high CPU usage seem to start when rising over a certain size limit
but I am not sure about that.
Example memory consuption of squid-3.1.4:
from 8.0 GB (4pm) to 8.4 GB (7pm) to 8.5 GB (4am next day) to 9,4 GB
(2pm).
At night there is low load on the squid, maybe 20-50 req/s.
3.1.3 behaves the same, so it does not seem to be related to the
"ctx enter/exit level" topic discussed in the last mails.

I am now reverting the proxies back to 3.0.STABLE25 but will keep one
proxy
on 3.1.4 for testing.
Probably something in my setup causes squid to consume too much memory.

Amos, do you have another idea what might causes this and where to look,
for example which debug depth? I can do some tests and have the
possibility
to slowly put this proxy under load and take it out of productive
environment afterwards...

Regards,
Martin

Amos Jeffries <squid3_at_treenet.co.nz> wrote on 15.06.2010 13:31:40:

<snip>
> > I am now checking with mem pools off on one of the proxies and report
> > later whether it changes anything.
<snip>
> > 2010/06/15 11:37:06| ctx: enter level 2059: '<lost>'
> > 2010/06/15 11:37:06| ctx: enter level 2060: '<lost>'
> > X:}0/06/15 11:37:06| WARNING: suspicious CR characters in HTTP header
{
> > 2010/06/15 11:37:06| ctx: exit level 2060
> > 2010/06/15 11:37:06| ctx: enter level 2060: '<lost>'
> > X:}0/06/15 11:37:06| WARNING: suspicious CR characters in HTTP header
{
> > 2010/06/15 11:37:06| ctx: exit level 2060
> > 2010/06/15 11:37:06| ctx: enter level 2060: '<lost>'
> > X:}0/06/15 11:37:06| WARNING: suspicious CR characters in HTTP header
{
> > 2010/06/15 11:37:06| ctx: exit level 2060
> > 2010/06/15 11:37:06| ctx: enter level 2060: '<lost>'
> > X:}0/06/15 11:37:06| WARNING: suspicious CR characters in HTTP header
{
> > 2010/06/15 11:37:06| ctx: exit level 2060
> > 2010/06/15 11:37:06| ctx: enter level 2060: '<lost>'
> > X:}0/06/15 11:37:06| WARNING: suspicious CR characters in HTTP header
{
> > 2010/06/15 11:40:56| ctx: exit level 2060
> > 2010/06/15 11:40:56| ctx: enter level 2060: '<lost>'
> > 2010/06/15 11:40:56| ctx: enter level 2061: '<lost>'
> >
>
> Ouch. We've been wondering about these ctx loops. It is not something to

> be terribly worried about, but can cause some "weird stuff" (yes that is

> probably the best explanation).
>
> Thanks to your reminder, I've just had another look and found one more
> in header processing. Hopefully that was it.
>
> Amos
> --
> Please be using
> Current Stable Squid 2.7.STABLE9 or 3.1.4
Received on Thu Jun 17 2010 - 13:45:48 MDT