Re: [SQU] [From CVS] cache no longer working ...

Okay, just up'd my SMBUFS to 256, assuming that my calculations are
correct in the last email ... still not getting anything out of cache,
with the following being the results of three reloads (not shift-reload,
just reload) of the page ... have even tried exiting browser and going
back in again ... is it the site I'm hitting that's the problem?

974831778.902 695 131.162.138.223 TCP_MISS/200 11201 GET http://www.hub.org/ - DIRECT/216.126.84.1 text/html
974831778.930 141 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/powerlogo.gif - DIRECT/216.126.84.1 -
974831778.982 79 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/php.gif - DIRECT/216.126.84.1 -
974831778.984 75 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/psql.jpg - DIRECT/216.126.84.1 -
974831779.024 74 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/bdot.gif - DIRECT/216.126.84.1 -
974831779.047 129 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/platinum.jpg - DIRECT/216.126.84.1 -
974831779.142 74 131.162.138.223 TCP_MISS/304 307 GET http://www.hub.org/images/vline.gif - DIRECT/216.126.84.1 -
974831779.143 74 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/top.gif - DIRECT/216.126.84.1 -
974831780.222 1155 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/newprices.gif - DIRECT/216.126.84.1 -
974831780.240 1169 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/pgsqldotcom.gif - DIRECT/216.126.84.1 -
974831791.389 1633 131.162.138.223 TCP_MISS/200 11201 GET http://www.hub.org/ - DIRECT/216.126.84.1 text/html
974831791.453 129 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/welcome.gif - DIRECT/216.126.84.1 -
974831791.462 129 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/curser.gif - DIRECT/216.126.84.1 -
974831791.736 215 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/pgsqldotcom.gif - DIRECT/216.126.84.1 -
974831791.937 198 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/bdot.gif - DIRECT/216.126.84.1 -
974831792.074 134 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/psql.jpg - DIRECT/216.126.84.1 -
974831792.233 155 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/php.gif - DIRECT/216.126.84.1 -
974831792.496 1158 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/curser.gif - DIRECT/216.126.84.1 -
974831792.639 141 131.162.138.223 TCP_MISS/304 308 GET http://www.hub.org/images/top.gif - DIRECT/216.126.84.1 -
974831792.647 1127 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/powerlogo.gif - DIRECT/216.126.84.1 -
974831792.648 1132 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/newprices.gif - DIRECT/216.126.84.1 -
974831792.824 184 131.162.138.223 TCP_MISS/304 307 GET http://www.hub.org/images/vline.gif - DIRECT/216.126.84.1 -
974831793.358 1123 131.162.138.223 TCP_MISS/304 309 GET http://www.hub.org/images/platinum.jpg - DIRECT/216.126.84.1 -

From the log, is grep'ng for _HIT sufficient:

demeter# wc -l access.log
   90086 access.log
demeter# grep _HIT !$ | wc -l
grep _HIT access.log | wc -l
   25420
demeter#

Does the following mean anything?

Nov 21 14:35:21 demeter squid[97255]: Beginning Validation Procedure
Nov 21 14:35:21 demeter squid[97255]: 262144 Entries Validated so far.
Nov 21 14:35:22 demeter squid[97255]: 524288 Entries Validated so far.
Nov 21 14:35:22 demeter squid[97255]: 786432 Entries Validated so far.
Nov 21 14:35:23 demeter squid[97255]: 1048576 Entries Validated so far.
Nov 21 14:35:23 demeter squid[97255]: 1310720 Entries Validated so far.
Nov 21 14:35:23 demeter squid[97255]: 1572864 Entries Validated so far.
Nov 21 14:35:24 demeter squid[97255]: 1835008 Entries Validated so far.
Nov 21 14:35:24 demeter squid[97255]: 2097152 Entries Validated so far.
Nov 21 14:35:24 demeter squid[97255]: 2359296 Entries Validated so far.
Nov 21 14:35:24 demeter squid[97255]: Completed Validation Procedure
Nov 21 14:35:24 demeter squid[97255]: Validated 2452362 Entries
Nov 21 14:35:24 demeter squid[97255]: store_swap_size = 40746983k
Nov 21 14:35:25 demeter squid[97255]: storeLateRelease: released 88 objects
Nov 21 14:36:20 demeter squid[97255]: parseHttpRequest: Unsupported method 'BPROPPATCH'
Nov 21 14:36:20 demeter squid[97255]: clientReadRequest: FD 131 Invalid Request
Nov 21 14:36:20 demeter squid[97255]: parseHttpRequest: Unsupported method 'BPROPPATCH'
Nov 21 14:36:20 demeter squid[97255]: clientReadRequest: FD 110 Invalid Request
Nov 21 14:36:34 demeter squid[97255]: parseHttpRequest: Unsupported method 'BPROPPATCH'
Nov 21 14:36:34 demeter squid[97255]: clientReadRequest: FD 334 Invalid Request
Nov 21 14:36:34 demeter squid[97255]: parseHttpRequest: Unsupported method 'BPROPPATCH'
Nov 21 14:36:34 demeter squid[97255]: clientReadRequest: FD 413 Invalid Request

On Tue, 21 Nov 2000, Marc G. Fournier wrote:

> On Tue, 21 Nov 2000, Adrian Chadd wrote:
>
> > On Tue, Nov 21, 2000, Marc G. Fournier wrote:
> > >
> > > Okay, not sure who maintains the FAQ, but this might be great for it, as I
> > > did check there first :)
> > >
> > > According to src/fs/diskd/store_diskd.h, SHMBUFS is 96, and they recommend
> > > Q2 (MAGIC2??) to be no more then 75% of that ... now, according to that
> > > file:
> > >
> > > /*
> > > * SHMBUFS is the number of shared memory buffers to allocate for
> > > * Each SwapDir.
> > > */
> > >
> > > so, if I have three swapdirs, then I need 96*3 is the numver of shared
> > > memory buffers I need to have configurd in my kernel, right? based on the
> > > FAQ, I have:
> > >
> > > options SYSVSHM #SYSV-style shared memory
> > > options SHMSEG=16 # max shared mem id's per process
> > > options SHMMNI=32 # max shared mem id's per system
> > > options SHMMAX=2097152 # max shared memory segment size (bytes)
> > > options SHMALL=4096 # max amount of shared memory (pages)
> > > options SYSVMSG #SYSV-style message queues
> > > options MSGMNB=16384 # max # of bytes in a queue
> > > options MSGMNI=41 # number of message queue identifiers
> > > options MSGSEG=2049 # number of message segments
> > > options MSGSSZ=64 # size of a message segment
> > > options MSGTQL=512 # max messages in system
> > > options SYSVSEM #SYSV-style semaphores
> > >
> > > right now (FreeBSD system) ... I've never been able to adequately figure
> > > this out ... SHMBUFS == ?? SHMSEG? Looking at the above, I'm suspecting
> > > that I don't have enough allocated at the kernel level, but am not sure
> > > which one I should be looking at :(
> >
> >
> > From memory:
> >
> > You'll want to make SHMMAX > SM_PAGE_SIZE * SMBUFS
>
> okay, so with SM_PAGE_SIZE of 4096, and SHMMAX of 2097152, I'm good for
> ~512 SMBUFS ... is it one of those "the more the better" sort of things,
> or is there a threshold?
>
> > You'll want to have SHMALL > (SM_PAGE_SIZE * SMBUFS * SwapDirs) / PAGESIZE
>
> 4096 > ( 512 * 4096 ) / 4096 ... so I should have more then enough setup
> in my kernel to handle up to 512 SMBUFS, if I'm understanding correctly
> ... ?
>
>
>
>
> --
> To unsubscribe, see http://www.squid-cache.org/mailing-lists.html
>
>

Marc G. Fournier marc.fournier@acadiau.ca
Senior Systems Administrator Acadia University

  "These are my opinions, which are not necessarily shared by my employer"

--
To unsubscribe, see http://www.squid-cache.org/mailing-lists.html