Re: [squid-users] Unable to increase filedescriptor limit -- tried all things

Try running squid manually; see if that works better.

Adrian

On Fri, Jan 25, 2008, bijayant kumar wrote:
> Hi,
> I did recompiled squid and entere the first line in
> /etc/init.d/squid as
> ulimit -n 8192
>
> and output of squid -v
>
> configure options: '--prefix=/usr'
> '--host=i686-pc-linux-gnu' '--mandir=/usr/share/man'
> '--infodir=/usr/share/info' '--datadir=/usr/share'
> '--sysconfdir=/etc' '--localstatedir=/var/lib'
> '--sysconfdir=/etc/squid'
> '--libexecdir=/usr/libexec/squid'
> '--localstatedir=/var' '--datadir=/usr/share/squid'
> '--enable-auth=basic,digest,ntlm'
> '--enable-removal-policies=lru,heap'
> '--enable-digest-auth-helpers=password'
> '--enable-basic-auth-helpers=PAM,LDAP,getpwnam,NCSA,MSNT'
> '--enable-external-acl-helpers=ldap_group,ip_user,session,unix_group'
> '--enable-ntlm-auth-helpers=fakeauth'
> '--enable-ident-lookups' '--enable-useragent-log'
> '--enable-cache-digests' '--enable-delay-pools'
> '--enable-referer-log' '--enable-arp-acl'
> '--with-pthreads' '--with-large-files' '--enable-htcp'
> '--enable-carp' '--enable-follow-x-forwarded-for'
> '*******--with-maxfd=8192****' '--enable-snmp'
> '--enable-ssl'
> '--enable-storeio=ufs,diskd,coss,aufs,null'
> '--enable-async-io' '--enable-linux-netfilter'
> '--enable-epoll' '--build=i686-pc-linux-gnu'
> 'build_alias=i686-pc-linux-gnu'
> 'host_alias=i686-pc-linux-gnu'
> 'CC=i686-pc-linux-gnu-gcc' 'CFLAGS=-O2 -march=i686 '
>
> But while restarting squid it still says
>
> 2008/01/25 11:33:25| With 1024 file descriptors
> available
>
> Please help me
>
> --- Adrian Chadd <adrian@creative.net.au> wrote:
>
> > Check ./squid -v ; see what it was compiled with.
> > Make sure you start squid after you change the
> > default ulimit.
> > Either put "ulimit -n 8192" at the top of the squid
> > startup
> > script or find the place where your default ulimits
> > are set
> > and modify that.
> >
> >
> >
> > Adrian
> >
> > On Fri, Jan 25, 2008, bijayant kumar wrote:
> > > Hi,
> > >
> > > While checking the squid-2.6.17.ebuild file i
> > found in
> > > econf section there is a line --with-maxfd=8192.
> > It
> > > means that squid has been compiled with 8192
> > > descriptors, right ?? But in cache.log it says
> > 1024
> > > file descriptors are available and complains about
> > the
> > > running out of file descriptors. Shall i have to
> > > recompile squid again in this case also ??
> > > Please guide me
> > >
> > >
> > >
> > > --- Manoj_Rajkarnikar <manoj@vianet.com.np> wrote:
> > >
> > > > On Fri, 25 Jan 2008, bijayant kumar wrote:
> > > >
> > > > > Hi Arana,
> > > > >
> > > > > Thanks for your reply. As you are suggesting
> > in
> > > > your
> > > > > reply that incresing the filedescriptor can be
> > > > > dangerous. Is there any other way to get rid
> > of
> > > > this
> > > > > warning, because this warning makes browsing
> > dead
> > > > > slow,and the box is deployed at our client
> > place.
> > > > I
> > > > > have to do things fast. If you have any other
> > > > > suggestion besides the increasing file
> > descriptor
> > > > > please suggest me.
> > > > >
> > > >
> > > > No AFAIK. you'll have to raise the FD limit but
> > > > don't raise it to tooo
> > > > high - that was the suggestion.. set it to 2048
> > or
> > > > 4096 to meet the
> > > > current and near-future workload requirement and
> > > > increase it again in the
> > > > future if needed...
> > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > --- Gonzalo Arana <gonzalo.arana@gmail.com>
> > wrote:
> > > > >
> > > > >> I would recommend you to run ./configure with
> > > > >> --with-maxfd=you_desired_limit and
> > --enable-epoll
> > > > >>
> > > > >> Watch for messages like this in configure
> > output:
> > > > >> checking if epoll works... yes
> > > > >> Using epoll for the IO loop.
> > > > >> ...
> > > > >> Maximum filedescriptors set to 131072
> > > > >> ...
> > > > >>
> > > > >> Having large number of FDs with select is
> > > > dangerous.
> > > > >> Also, I recall
> > > > >> there was an issue on increasing FD_SETSIZE
> > on
> > > > glibc
> > > > >> (Linux uses
> > > > >> glibc).
> > > > >>
> > > > >> HTH,
> > > > >>
> > > > >> On Jan 24, 2008 11:46 AM, Bijayant
> > > > >> <bijayant4u@yahoo.com> wrote:
> > > > >>> Hello list,
> > > > >>>
> > > > >>> I am using squid as proxy server on gentoo
> > box.
> > > > >> All of a sudden from
> > > > >>> 2nd January in my cache.log i am seeing the
> > > > error
> > > > >>>
> > > > >>> WARNING! Your cache is running out of
> > > > >> filedescriptors
> > > > >>>
> > > > >>> When this messages repeats frequently,
> > browsing
> > > > >> becomes dead slow in
> > > > >>> 2mbps line. We have 2GB RAM, and 1 GB swap
> > ,
> > > > dual
> > > > >> core processor system.
> > > > >>>
> > > > >>> After googling, checking Squid Faq i have
> > tried
> > > > to
> > > > >> increase the limit
> > > > >>> of filedescriptors on my system. But i am
> > not
> > > > >> able to do. Please help me
> > > > >>> out. here i am giving some information for
> > > > better
> > > > >> picture
> > > > >>>
> > > > >>> OS - gentoo
> > > > >>> Kernel - 2.6.18-gentoo-r6
> > > > >>> Squid - net-proxy/squid-2.6.12
> > > > >>> USE Flags=ipf-transparent pam ssl
> > > > >>>
> > > > >>> I have changed the filedescriptors in
> > > > >> /usr/include/bits/typesizes.h
> > > > >>>
> > > > >>> Number of descriptors that can fit in an
> > > > `fd_set'
> > > > >>> #define __FD_SETSIZE 2048
> > > > >>>
> > > > >>>
> > > > >>> In /etc/init.d/squid
> > > > >>> ulimit -HSn 2048
> > > > >>>
> > > > >>> ~ $ cat /proc/sys/fs/file-max
> > > > >>> 50516
> > > > >>>
> > > > >>> The relevant part of /etc/squid/squid.conf
> > after
> > > > >> search on google/faq
> > > > >>>
> > > > >>>
> > > > >>> client_persistent_connections off
> > > > >>> server_persistent_connections off
> > > > >>> cache_dir ufs /var/cache/squid 2000 16 256
> > > > >>> url_rewrite_children 30
> > > > >>>
> > > > >>>
> > > > >>> I did all things specified in Squid Wiki and
> > > > Faq.
> > > > >> After that i have
> > > > >>> recompiled the squid and rebooted my
> > machine
> > > > also
> > > > >> without any luck. I am
> > > > >>> still getting the warning in my logs, and
> > > > ulimit
> > > > >> -n as 1024.
> > > > >>>
> > > > >>> I have tried all possible things without any
> > > > >> success. Please help me or
> > > > >>> give me some direction.
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Gonzalo A. Arana
> > > > >>
> > > > >
> > > > >
> > > > > Bijayant Kumar
> > > > >
> > > > > Send instant messages to your online friends
> > > > http://uk.messenger.yahoo.com
> > > > >
> > > >
> > > > --
> > > >
> > >
> > >
> > > Bijayant Kumar
> > >
> > > Send instant messages to your online friends
> > http://uk.messenger.yahoo.com
> >
> > --
> > - Xenion - http://www.xenion.com.au/ - VPS Hosting -
> > Commercial Squid Support -
> > - $25/pm entry-level VPSes w/ capped bandwidth
> > charges available in WA -
> >
>
>
> Bijayant Kumar
>
> Send instant messages to your online friends http://uk.messenger.yahoo.com

-- 
- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -