Re: [squid-users] Splitting objects by size into different cache_dir not working for me

Steel can not make this setup to work properly.

Is cache_dir max/min-size somehow broken on 3.2.6 and this makes
distribute objects by size impossible?

Or I'm trying to do something that can't be achieved?

On 01/25/2013 01:06 PM, Luciano Ruete wrote:
> On 01/24/2013 08:44 PM, Amos Jeffries wrote:
>> On 25/01/2013 3:48 a.m., Luciano Ruete wrote:
>>> Hi,
>>>
>>> I'm trying to unload I/O on a bussy server (about 100M/bit Internet
>>> link and 3000 ISP customers), by splitting cache_dir on two
>>> different storages(and media) as an starting point (later I would
>>> like also to use SMP features, but for now I'm getting too many errors)
>>>
>>>
>>
>> For starters please upgrade to 3.2.6. There is a recent log rotation
>> regression present in 3.2 up to 3.2.5.
>>
>
> Done, thanks for the hint.
>
>>
>>> What I'have done is
>>>
>>> workers 1
>>> cache_dir rock /var/spool/squid/rock 10000 max-size=31000
>>> max-swap-rate=250 swap-timeout=350
>>> cache_dir aufs /var/spool/squid/aufs 300000 16 256 min-size=310001
>>>
>>
>> There is a bug still in 3.2.6 whereby if any cache_dir line has
>> max-size set they all need one.
>> As a workaround you can take the value from maximum_object_size
>> (which is the global disk maximum) and set it as max-size=N on your
>> AUFS directory.
>>
>
> I've updated cache_dir lines to have both max-size and min-size set.
>
> But the odd behavior still persists. Only the rock cache_dir grows and
> even if it gets full the AUFS directory never starts to save objects.
>
> I've tried both store_dir_select_algorithm (round-robin and the
> defualt) but it doesn't help.
>
> Updated conf file:
>
> acl localnet src all
> acl SSL_ports port 443
> acl Safe_ports port 80 # http
> acl Safe_ports port 21 # ftp
> acl Safe_ports port 443 # https
> acl Safe_ports port 70 # gopher
> acl Safe_ports port 210 # wais
> acl Safe_ports port 1025-65535 # unregistered ports
> acl Safe_ports port 280 # http-mgmt
> acl Safe_ports port 488 # gss-http
> acl Safe_ports port 591 # filemaker
> acl Safe_ports port 777 # multiling http
> acl CONNECT method CONNECT
> http_access allow localhost manager
> http_access deny manager
> http_access deny !Safe_ports
> http_access deny CONNECT !SSL_ports
> http_access allow localhost
> http_access allow localnet
> http_access deny all
> http_port 3128
> http_port 3129 tproxy
> coredump_dir /var/spool/squid
> refresh_pattern ^ftp: 1440 20% 10080
> refresh_pattern ^gopher: 1440 0% 1440
> refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
> refresh_pattern . 0 20% 4320
> shutdown_lifetime 0 seconds
> max_filedescriptors 65536
> cache_store_log daemon:/var/log/squid3/store.log
> workers 1
> cache_mem 256 MB
> maximum_object_size_in_memory 8 KB
> max_open_disk_fds 0
> maximum_object_size 700 MB
> minimum_object_size 0 KB
> store_dir_select_algorithm round-robin
> cache_dir rock /var/spool/squid/rock 1000 min-size=1024 max-size=31000
> max-swap-rate=250 swap-timeout=350
> cache_dir aufs /var/spool/squid/aufs 30000 16 256 min-size=31001
> max-size=734003200
>
> Squid Cache: Version 3.2.6
> configure options: '--build=x86_64-linux-gnu' '--prefix=/usr'
> '--includedir=${prefix}/include' '--mandir=${prefix}/share/man'
> '--infodir=${prefix}/share/info' '--sysconfdir=/etc'
> '--localstatedir=/var' '--libexecdir=${prefix}/lib/squid3-ssl'
> '--srcdir=.' '--disable-maintainer-mode'
> '--disable-dependency-tracking' '--disable-silent-rules'
> '--datadir=/usr/share/squid3' '--sysconfdir=/etc/squid3'
> '--libdir=/usr/lib/squid3' '--libexecdir=/usr/lib/squid3'
> '--mandir=/usr/share/man' '--with-cppunit-basedir=/usr' '--enable-ssl'
> '--enable-ssl-crtd' '--enable-inline' '--enable-async-io=8'
> '--enable-storeio=ufs,aufs,diskd,rock'
> '--enable-removal-policies=lru,heap' '--enable-delay-pools'
> '--enable-cache-digests' '--enable-underscores' '--enable-icap-client'
> '--enable-follow-x-forwarded-for' '--enable-auth-basic'
> '--enable-auth-digest' '--enable-auth-ntlm' '--enable-auth-negotiate'
> '--enable-basic-auth-helpers=LDAP,MSNT,NCSA,PAM,SASL,SMB,YP,DB,POP3,getpwnam,squid_radius_auth,multi-domain-NTLM'
> '--enable-ntlm-auth-helpers=smb_lm,'
> '--enable-digest-auth-helpers=ldap,password'
> '--enable-negotiate-auth-helpers=squid_kerb_auth'
> '--enable-external-acl-helpers=ip_user,ldap_group,session,unix_group,wbinfo_group'
> '--enable-arp-acl' '--enable-esi' '--disable-ipv6'
> '--disable-translation' '--with-logdir=/var/log/squid3'
> '--with-pidfile=/var/run/squid3.pid' '--with-filedescriptors=65536'
> '--with-large-files' '--with-default-user=proxy'
> '--enable-linux-netfilter' 'build_alias=x86_64-linux-gnu' 'CFLAGS=-g
> -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat
> -Wformat-security -g -O2 -fstack-protector --param=ssp-buffer-size=4
> -Wformat -Wformat-security -Werror=format-security -Wall'
> 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro'
> 'CPPFLAGS=-D_FORTIFY_SOURCE=2' 'CXXFLAGS=-g -O2 -fstack-protector
> --param=ssp-buffer-size=4 -Wformat -Wformat-security -g -O2
> -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security
> -Werror=format-security -Wall'
>
>
>
>
Received on Mon Jan 28 2013 - 13:54:44 MST