Re: [squid-users] squid 2.0.PATCH2 filled cache and stopped

On Tue, Nov 17, 1998 at 11:20:07AM +1030, Lachlan Cameron-Smith wrote:

> The other night our squid cache (2.0.PATCH2) stopped at 1:19 in the morning, after filling one
> of our cache directories to the hilt... the following error messages were found in cache.log:
>
> 1998/11/15 01:18:58| diskHandleWrite: FD 73: disk write error: (28) No space left on device
> 1998/11/15 01:18:58| storeSwapOutHandle: SwapOut failure (err code = -6).
> 1998/11/15 01:18:58| WARNING: Shrinking cache_dir #3 to 1903410 KB
> 1998/11/15 01:19:00| diskHandleWrite: FD 43: disk write error: (28) No space left on device
> 1998/11/15 01:19:00| storeDirWriteCleanLogs: Starting...
> 1998/11/15 01:19:00| WARNING: Closing open FD 66
> 1998/11/15 01:19:00| WARNING: Closing open FD 67
> 1998/11/15 01:19:00| storeDirWriteCleanLogs: /usr/local/squid/cache/4/swap.state.clean: write: (28) No
> space left on device
> 1998/11/15 01:19:00| storeDirWriteCleanLogs: Current swap logfile not replaced.
> 1998/11/15 01:19:01| 65536 entries written so far.
> 1998/11/15 01:19:01| 131072 entries written so far.
> 1998/11/15 01:19:02| 196608 entries written so far.
> 1998/11/15 01:19:02| 262144 entries written so far.
> 1998/11/15 01:19:03| 327680 entries written so far.
> 1998/11/15 01:19:03| Finished. Wrote 379623 entries.
> 1998/11/15 01:19:03| Took 3 seconds (126541.0 entries/sec).
> FATAL: Write failure -- check your disk space and cache.log
>
> Every restart after this died after trying to write to the full directory :(
>
> Perhaps squid could just disable the full directory in cases like these and
> continue to use the remaining ones, rather than just stopping?

Squid died like this because you have your "swap" logs on the same disks as
the actual cache. When the actual disks fill up, not only can squid no
longer store more objects but it can't write to the swap log either.

Move the swap logs onto a different disk and you remove this problem
(although you need to make sure that the disk you move the logs onto doesn't
itself fill up, too!).

Cheers,

Chris

-- 
Chris Tilbury, UNIX Systems Administrator, IT Services, University of Warwick
EMAIL: cudch+s@csv.warwick.ac.uk PHONE: +44 1203 523365(V)/+44 1203 523267(F)
                            URL: http://www.warwick.ac.uk/staff/Chris.Tilbury