Re: Squid memory footprint (was: MemPools rewrite)

Stephen, I think you'll find the development model of Squid is now a lot
more open than it was back then. The Sourceforge site is available, and
I imagine Henrik and Adrian would be happy to have you start a branch
there to merge these changes into, so we can start thinking about
getting them tested for inclusion in an official Squid not too far down
the road.

Sounds like you've done some cool stuff that folks here would like to
have a look at. (Ok, some of us weren't around back in June of '99 so
we missed the first boat, maybe another will come along? ;-)

My .02

"Stephen R. van den Berg" wrote:
>
> Chemolli Francesco (USI) wrote:
> >> I wonder how can you eliminate StoreEntry? IMHO it contains crucial
> >> information that allows squid to skip disk accesses. Moving parts
> >> of this data into squidfs doesn't seem to change much in ram usage.
> >> Moving this crucial information onto disks implies enormous
> >> performance
> >> penalty, doesn't it?
>
> >I don't know if and how it could be done, but what about moving
> >all storeentry structures in a BIG chunk mmapped on the
> >swap.state file?
>
> Been there, done that.
>
> > This way the OS would be in charge of doing
> >pagein and outs for us.
> >Besides, we could save up tons of startup time for swap.state
> >parsing and checks: just mark the file clean, compute an MD5
> >checksum and store it somewhere This could allow for
> >simultaneous access by two processes (synchronous double-checking).
> >No heap fragmentation problems either, reallocs are easy,
> >disk space is cheap.
>
> Yep, works like a dream. Been running squid like this for more than
> two years like this.
>
> >It all seems too perfect. Only disadvantage I can see, we'd have
> >to implement memory-management on the thing. But if we KNOW
> >that all objects have the same size (which is not entirely true,
> >but we could maybe do some storage organization tricks), it should
> >be relatively easy.
>
> It is. The patches I've created have been published on squid-dev
> in June 1999.

                                  --
                     Joe Cooper <joe@swelltech.com>
                 Affordable Web Caching Proxy Appliances
                        http://www.swelltech.com
Received on Thu Nov 09 2000 - 21:42:18 MST