[squid-users] Virtual Memory

Hello,

I´m running squid 2.5 STABLE 11 on DELL Poweredge 800

- Kernel 2.6.16-13 64bits EMT64
- 1 HD SCSI 10.000 rpm 73gb for cache_dir (splited in two partitions)

with configure line:

--build=x86_64-redhat-linux-gnu --host=x86_64-redhat-linux-gnu
--target=x86_64-redhat-linux-gnu --program-prefix= --prefix=/usr
--exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin
--sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include
--libdir=/usr/lib64 --libexecdir=/usr/libexec --localstatedir=/var
--sharedstatedir=/usr/com --mandir=/usr/share/man
--infodir=/usr/share/info --exec_prefix=/usr --bindir=/usr/sbin
--libexecdir=/usr/lib64/squid --localstatedir=/var
--sysconfdir=/etc/squid --enable-poll --enable-snmp
--enable-removal-policies=heap,lru
--enable-storeio=aufs,coss,diskd,null,ufs --enable-ssl
--with-openssl=/usr/kerberos --enable-linux-netfilter --with-pthreads
--enable-external-acl-helpers=ip_user,unix_group
--with-winbind-auth-challenge --enable-useragent-log
--enable-referer-log --disable-dependency-tracking
--enable-cachemgr-hostname=localhost --disable-ident-lookups
--enable-truncate --enable-underscores --datadir=/usr/share
--with-maxfd=4096 --enable-async-io --enable-dlmalloc

i´m running squid with heap replacement policies (LFUDA for cache and
GDSF for memory)

cache_mem 384 MB
maximum_object_size 50 MB
minimum_object_size 0 KB
maximum_object_size_in_memory 128 KB

cache_dir aufs /var/spool/squid1 30720 32 512
cache_dir aufs /var/spool/squid2 30720 32 512
memory_pools off

When squid process reaches +- 1270000 of VSZ. and +- 900MB of RSS it´s
die with this message:

2006/10/09 00:02:06| storeDirClean: /var/spool/squid2/00/1CF: (12)
Cannot allocate memory
FATAL: xcalloc: Unable to allocate 1 blocks of 4112 bytes!

Squid Cache (Version 2.5.STABLE11): Terminated abnormally.
CPU Usage: 1353.557 seconds = 536.278 user + 817.279 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 2
Memory usage for squid via mallinfo():
        total space in arena: 1041484 KB
        Ordinary blocks: 1039844 KB 551 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 36624 KB 7 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 1639 KB
        Total in use: 1076468 KB 103%
        Total free: 1639 KB 0%
2006/10/09 00:02:07| storeDirWriteCleanLogs: Starting...
2006/10/09 00:02:07| WARNING: Closing open FD 15

squid receives +- 30 req/s, and 200 users simultaneous...

the server has 2.5 G of memory..

the consumption of memory without squid is about 600 MB..

i tried to compile squid with --disable-dlmalloc but squid crash more
"faster"... (2 in 2 hours)..

now, ps auwx show

USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
squid 903 2.8 38.2 1218264 981428 ? Sl 00:02 17:20 (squid) -D -s

on the last week this server was with 1GB of ram... and occur the same
error.. i install more 1.5GB of ram.. but.. the problem continues..

sysctl kernel parms:

kernel.msgmnb = 16384
kernel.msgmni = 64
kernel.msgmax = 8192
fs.file-max = 65534
kernel.shmmax = 2147483648
kernel.shmmni = 4096

somebody can say me what´s happening ?

Regards !!!

Alexandre J . Correa .
Onda Internet
www.ondainternet.com.br
Received on Mon Oct 09 2006 - 07:26:28 MDT