Re: [squid-users] Splitting objects by size into different cache_dir not working for me

On 01/24/2013 08:44 PM, Amos Jeffries wrote:
> On 25/01/2013 3:48 a.m., Luciano Ruete wrote:
>> Hi,
>>
>> I'm trying to unload I/O on a bussy server (about 100M/bit Internet
>> link and 3000 ISP customers), by splitting cache_dir on two different
>> storages(and media) as an starting point (later I would like also to
>> use SMP features, but for now I'm getting too many errors)
>>
>>
>
> For starters please upgrade to 3.2.6. There is a recent log rotation
> regression present in 3.2 up to 3.2.5.
>

Done, thanks for the hint.

>
>> What I'have done is
>>
>> workers 1
>> cache_dir rock /var/spool/squid/rock 10000 max-size=31000
>> max-swap-rate=250 swap-timeout=350
>> cache_dir aufs /var/spool/squid/aufs 300000 16 256 min-size=310001
>>
>
> There is a bug still in 3.2.6 whereby if any cache_dir line has
> max-size set they all need one.
> As a workaround you can take the value from maximum_object_size (which
> is the global disk maximum) and set it as max-size=N on your AUFS
> directory.
>

I've updated cache_dir lines to have both max-size and min-size set.

But the odd behavior still persists. Only the rock cache_dir grows and
even if it gets full the AUFS directory never starts to save objects.

I've tried both store_dir_select_algorithm (round-robin and the defualt)
but it doesn't help.

Updated conf file:

acl localnet src all
acl SSL_ports port 443
acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT
http_access allow localhost manager
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports
http_access allow localhost
http_access allow localnet
http_access deny all
http_port 3128
http_port 3129 tproxy
coredump_dir /var/spool/squid
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
refresh_pattern . 0 20% 4320
shutdown_lifetime 0 seconds
max_filedescriptors 65536
cache_store_log daemon:/var/log/squid3/store.log
workers 1
cache_mem 256 MB
maximum_object_size_in_memory 8 KB
max_open_disk_fds 0
maximum_object_size 700 MB
minimum_object_size 0 KB
store_dir_select_algorithm round-robin
cache_dir rock /var/spool/squid/rock 1000 min-size=1024 max-size=31000
max-swap-rate=250 swap-timeout=350
cache_dir aufs /var/spool/squid/aufs 30000 16 256 min-size=31001
max-size=734003200

Squid Cache: Version 3.2.6
configure options: '--build=x86_64-linux-gnu' '--prefix=/usr'
'--includedir=${prefix}/include' '--mandir=${prefix}/share/man'
'--infodir=${prefix}/share/info' '--sysconfdir=/etc'
'--localstatedir=/var' '--libexecdir=${prefix}/lib/squid3-ssl'
'--srcdir=.' '--disable-maintainer-mode' '--disable-dependency-tracking'
'--disable-silent-rules' '--datadir=/usr/share/squid3'
'--sysconfdir=/etc/squid3' '--libdir=/usr/lib/squid3'
'--libexecdir=/usr/lib/squid3' '--mandir=/usr/share/man'
'--with-cppunit-basedir=/usr' '--enable-ssl' '--enable-ssl-crtd'
'--enable-inline' '--enable-async-io=8'
'--enable-storeio=ufs,aufs,diskd,rock'
'--enable-removal-policies=lru,heap' '--enable-delay-pools'
'--enable-cache-digests' '--enable-underscores' '--enable-icap-client'
'--enable-follow-x-forwarded-for' '--enable-auth-basic'
'--enable-auth-digest' '--enable-auth-ntlm' '--enable-auth-negotiate'
'--enable-basic-auth-helpers=LDAP,MSNT,NCSA,PAM,SASL,SMB,YP,DB,POP3,getpwnam,squid_radius_auth,multi-domain-NTLM'
'--enable-ntlm-auth-helpers=smb_lm,'
'--enable-digest-auth-helpers=ldap,password'
'--enable-negotiate-auth-helpers=squid_kerb_auth'
'--enable-external-acl-helpers=ip_user,ldap_group,session,unix_group,wbinfo_group'
'--enable-arp-acl' '--enable-esi' '--disable-ipv6'
'--disable-translation' '--with-logdir=/var/log/squid3'
'--with-pidfile=/var/run/squid3.pid' '--with-filedescriptors=65536'
'--with-large-files' '--with-default-user=proxy'
'--enable-linux-netfilter' 'build_alias=x86_64-linux-gnu' 'CFLAGS=-g -O2
-fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security
-g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat
-Wformat-security -Werror=format-security -Wall'
'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro'
'CPPFLAGS=-D_FORTIFY_SOURCE=2' 'CXXFLAGS=-g -O2 -fstack-protector
--param=ssp-buffer-size=4 -Wformat -Wformat-security -g -O2
-fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security
-Werror=format-security -Wall'
Received on Fri Jan 25 2013 - 16:13:13 MST