Re: [squid-users] Unable to increase filedescriptor limit -- tried all things

From: bijayant kumar <bijayant4u@dont-contact.us>
Date: Fri, 25 Jan 2008 06:08:37 +0000 (GMT)

Hi,
I did recompiled squid and entere the first line in
/etc/init.d/squid as
ulimit -n 8192

and output of squid -v

configure options: '--prefix=/usr'
'--host=i686-pc-linux-gnu' '--mandir=/usr/share/man'
'--infodir=/usr/share/info' '--datadir=/usr/share'
'--sysconfdir=/etc' '--localstatedir=/var/lib'
'--sysconfdir=/etc/squid'
'--libexecdir=/usr/libexec/squid'
'--localstatedir=/var' '--datadir=/usr/share/squid'
'--enable-auth=basic,digest,ntlm'
'--enable-removal-policies=lru,heap'
'--enable-digest-auth-helpers=password'
'--enable-basic-auth-helpers=PAM,LDAP,getpwnam,NCSA,MSNT'
'--enable-external-acl-helpers=ldap_group,ip_user,session,unix_group'
'--enable-ntlm-auth-helpers=fakeauth'
'--enable-ident-lookups' '--enable-useragent-log'
'--enable-cache-digests' '--enable-delay-pools'
'--enable-referer-log' '--enable-arp-acl'
'--with-pthreads' '--with-large-files' '--enable-htcp'
'--enable-carp' '--enable-follow-x-forwarded-for'
'*******--with-maxfd=8192****' '--enable-snmp'
'--enable-ssl'
'--enable-storeio=ufs,diskd,coss,aufs,null'
'--enable-async-io' '--enable-linux-netfilter'
'--enable-epoll' '--build=i686-pc-linux-gnu'
'build_alias=i686-pc-linux-gnu'
'host_alias=i686-pc-linux-gnu'
'CC=i686-pc-linux-gnu-gcc' 'CFLAGS=-O2 -march=i686 '

But while restarting squid it still says

2008/01/25 11:33:25| With 1024 file descriptors
available

Please help me

--- Adrian Chadd <adrian@creative.net.au> wrote:

> Check ./squid -v ; see what it was compiled with.
> Make sure you start squid after you change the
> default ulimit.
> Either put "ulimit -n 8192" at the top of the squid
> startup
> script or find the place where your default ulimits
> are set
> and modify that.
>
>
>
> Adrian
>
> On Fri, Jan 25, 2008, bijayant kumar wrote:
> > Hi,
> >
> > While checking the squid-2.6.17.ebuild file i
> found in
> > econf section there is a line --with-maxfd=8192.
> It
> > means that squid has been compiled with 8192
> > descriptors, right ?? But in cache.log it says
> 1024
> > file descriptors are available and complains about
> the
> > running out of file descriptors. Shall i have to
> > recompile squid again in this case also ??
> > Please guide me
> >
> >
> >
> > --- Manoj_Rajkarnikar <manoj@vianet.com.np> wrote:
> >
> > > On Fri, 25 Jan 2008, bijayant kumar wrote:
> > >
> > > > Hi Arana,
> > > >
> > > > Thanks for your reply. As you are suggesting
> in
> > > your
> > > > reply that incresing the filedescriptor can be
> > > > dangerous. Is there any other way to get rid
> of
> > > this
> > > > warning, because this warning makes browsing
> dead
> > > > slow,and the box is deployed at our client
> place.
> > > I
> > > > have to do things fast. If you have any other
> > > > suggestion besides the increasing file
> descriptor
> > > > please suggest me.
> > > >
> > >
> > > No AFAIK. you'll have to raise the FD limit but
> > > don't raise it to tooo
> > > high - that was the suggestion.. set it to 2048
> or
> > > 4096 to meet the
> > > current and near-future workload requirement and
> > > increase it again in the
> > > future if needed...
> > >
> > > >
> > > >
> > > >
> > > >
> > > > --- Gonzalo Arana <gonzalo.arana@gmail.com>
> wrote:
> > > >
> > > >> I would recommend you to run ./configure with
> > > >> --with-maxfd=you_desired_limit and
> --enable-epoll
> > > >>
> > > >> Watch for messages like this in configure
> output:
> > > >> checking if epoll works... yes
> > > >> Using epoll for the IO loop.
> > > >> ...
> > > >> Maximum filedescriptors set to 131072
> > > >> ...
> > > >>
> > > >> Having large number of FDs with select is
> > > dangerous.
> > > >> Also, I recall
> > > >> there was an issue on increasing FD_SETSIZE
> on
> > > glibc
> > > >> (Linux uses
> > > >> glibc).
> > > >>
> > > >> HTH,
> > > >>
> > > >> On Jan 24, 2008 11:46 AM, Bijayant
> > > >> <bijayant4u@yahoo.com> wrote:
> > > >>> Hello list,
> > > >>>
> > > >>> I am using squid as proxy server on gentoo
> box.
> > > >> All of a sudden from
> > > >>> 2nd January in my cache.log i am seeing the
> > > error
> > > >>>
> > > >>> WARNING! Your cache is running out of
> > > >> filedescriptors
> > > >>>
> > > >>> When this messages repeats frequently,
> browsing
> > > >> becomes dead slow in
> > > >>> 2mbps line. We have 2GB RAM, and 1 GB swap
> ,
> > > dual
> > > >> core processor system.
> > > >>>
> > > >>> After googling, checking Squid Faq i have
> tried
> > > to
> > > >> increase the limit
> > > >>> of filedescriptors on my system. But i am
> not
> > > >> able to do. Please help me
> > > >>> out. here i am giving some information for
> > > better
> > > >> picture
> > > >>>
> > > >>> OS - gentoo
> > > >>> Kernel - 2.6.18-gentoo-r6
> > > >>> Squid - net-proxy/squid-2.6.12
> > > >>> USE Flags=ipf-transparent pam ssl
> > > >>>
> > > >>> I have changed the filedescriptors in
> > > >> /usr/include/bits/typesizes.h
> > > >>>
> > > >>> Number of descriptors that can fit in an
> > > `fd_set'
> > > >>> #define __FD_SETSIZE 2048
> > > >>>
> > > >>>
> > > >>> In /etc/init.d/squid
> > > >>> ulimit -HSn 2048
> > > >>>
> > > >>> ~ $ cat /proc/sys/fs/file-max
> > > >>> 50516
> > > >>>
> > > >>> The relevant part of /etc/squid/squid.conf
> after
> > > >> search on google/faq
> > > >>>
> > > >>>
> > > >>> client_persistent_connections off
> > > >>> server_persistent_connections off
> > > >>> cache_dir ufs /var/cache/squid 2000 16 256
> > > >>> url_rewrite_children 30
> > > >>>
> > > >>>
> > > >>> I did all things specified in Squid Wiki and
> > > Faq.
> > > >> After that i have
> > > >>> recompiled the squid and rebooted my
> machine
> > > also
> > > >> without any luck. I am
> > > >>> still getting the warning in my logs, and
> > > ulimit
> > > >> -n as 1024.
> > > >>>
> > > >>> I have tried all possible things without any
> > > >> success. Please help me or
> > > >>> give me some direction.
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Gonzalo A. Arana
> > > >>
> > > >
> > > >
> > > > Bijayant Kumar
> > > >
> > > > Send instant messages to your online friends
> > > http://uk.messenger.yahoo.com
> > > >
> > >
> > > --
> > >
> >
> >
> > Bijayant Kumar
> >
> > Send instant messages to your online friends
> http://uk.messenger.yahoo.com
>
> --
> - Xenion - http://www.xenion.com.au/ - VPS Hosting -
> Commercial Squid Support -
> - $25/pm entry-level VPSes w/ capped bandwidth
> charges available in WA -
>

Bijayant Kumar

Send instant messages to your online friends http://uk.messenger.yahoo.com
Received on Thu Jan 24 2008 - 23:08:44 MST

This archive was generated by hypermail pre-2.1.9 : Fri Feb 01 2008 - 12:00:05 MST