[squid-users] after long time squid hang , no logs , kill the internet , and i must restart it !!!!!

From: Dr.x <ahmed.zaeem_at_netstream.ps>
Date: Mon, 16 Dec 2013 03:38:24 -0800 (PST)

hi all ,

i want to mention a strange problem in squid .

im using smp with squid 3.3.9

this problem is as follow :

squid start fine ,

after about 7-10 days , log files stop , squid hanged , but wccp still
active with cisco router , and as a result the users complain from "NO
Iinternet access"
it seems kill the http traffic

but before that hang occurs ,

i note that just * kid3* is restarted many times i see it in cache.log
, im not sure if that is natural !!
i mean that kid3 may restarted many times and squid still running *(not sure
if this has realtion to problem before it occurs )*

note that kid3 is not a disker process .

agian , the hang is on squid only , not on system as all .

wish to help , what to monitor and how troubleshoot before and after the
hang occurs .

i have 8 G ram , i have 8 cores on my machine .

my options :
Squid Cache: Version 3.3.9
configure options: '--build=i486-linux-gnu' '--prefix=/usr'
'--includedir=/include' '--mandir=/share/man' '--infodir=/share/info'
'--sysconfdir=/etc' '--enable-cachemgr-hostname=drx' '--localstatedir=/var'
'--libexecdir=/lib/squid' '--disable-maintainer-mode'
'--disable-dependency-tracking' '--disable-silent-rules' '--srcdir=.'
'--datadir=/usr/share/squid' '--sysconfdir=/etc/squid'
'--mandir=/usr/share/man' '--enable-inline' '--enable-async-io=8'
'--enable-storeio=ufs,aufs,diskd,rock' '--enable-removal-policies=lru,heap'
'--enable-delay-pools' '--enable-cache-digests' '--enable-underscores'
'--enable-icap-client' '--enable-follow-x-forwarded-for' '--enable-auth'
'--enable-basic-auth-helpers=LDAP,MSNT,NCSA,PAM,SASL,SMB,YP,DB,POP3,getpwnam,squid_radius_auth,multi-domain-NTLM'
'--enable-ntlm-auth-helpers=smb_lm'
'--enable-digest-auth-helpers=ldap,password'
'--enable-negotiate-auth-helpers=squid_kerb_auth'
'--enable-external-acl-helpers=ip_user,ldap_group,session,unix_group,wbinfo_group'
'--enable-arp-acl' '--enable-esi' '--disable-translation'
'--with-logdir=/var/log/squid' '--with-pidfile=/var/run/squid.pid'
'--with-filedescriptors=131072' '--with-large-files'
'--with-default-user=squid' '--enable-linux-netfilter'
'build_alias=i486-linux-gnu' 'CFLAGS=-g -O2 -g -Wall -O2' 'LDFLAGS='
'CPPFLAGS=' 'CXXFLAGS=-g -O2 -g -Wall -O2' --enable-ltdl-convenience
==================================================

my squid.conf file :
#################################################################
# Example rule allowing access from your local networks.
# Adapt to list your (internal) IP networks from where browsing
# should be allowed
acl localnet src 10.0.0.0/8 # RFC1918 possible internal network
acl localnet src 172.16.0.0/12 # RFC1918 possible internal network
acl localnet src 192.168.0.0/16 # RFC1918 possible internal network
acl localnet src fc00::/7 # RFC 4193 local private network range
acl localnet src fe80::/10 # RFC 4291 link-local (directly plugged)
machines
acl mysubnet src zzzzzzzzzzzzzzzzz
acl localip src yyyyyyyyyyyyyyyy/32

acl SSL_ports port 443
acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT
######################################################
# Recommended minimum Access Permission configuration:
# Deny requests to certain unsafe ports

http_access deny !Safe_ports
http_access allow localnet
# Deny CONNECT to other than secure SSL ports
http_access deny CONNECT !SSL_ports
#######################################################
###########SMP oPTIONS#####################
dns_v4_first on
# 3 workers, using worker #1 as the frontend is important
workers 3
########################################################
cpu_affinity_map process_numbers=1,2,3,4 cores=2,4,6,8
#########################################
visible_hostname squid.drx
####################################################
####Filterring##############
acl blockkeywords dstdomain "/etc/squid/koko.acl"
http_access deny blockkeywords
#################################################
cache_log /var/log/squid/cache.log
access_log stdio:/var/log/squid/access.log
###############################################
http_port xxxxxxxxxxxxxxxx
http_port xxxxxxxxxxxxxxxxxxxxxx tproxy
############################################################################
http_access allow mysubnet
############################################################################################
cache_mgr a_at_a
cachemgr_passwd a all
#######################################################
# add user authentication and similar options here
http_access allow manager localhost
http_access allow manager localip
http_access allow manager mysubnet
http_access allow mysubnet manager
http_access deny manager
#######################################################################
cache_mem 512 MB
maximum_object_size 10 MB
##################################################
# the frontend requires a different name to the backend
#######################################################################
cache_swap_low 90
cache_swap_high 95
###########################################################
#########################################################
quick_abort_pct 95
fqdncache_size 65535
ipcache_size 65535
###########################################################
ipcache_low 98
ipcache_high 99
#####################################################
########### WCCP2 Config#############
wccp2_router xxxxxxx
wccp2_rebuild_wait off
wccp_version 2
wccp2_return_method 2
wccp2_service dynamic 92
wccp2_service_info 92 protocol=tcp flags=src_ip_hash priority=250 ports=80
wccp2_service dynamic 93
wccp2_service_info 93 protocol=tcp flags=dst_ip_hash,ports_source
priority=250 ports=80
######################################################
cache_effective_user squid
cache_effective_group squid
#######################################################
memory_replacement_policy heap GDSF
cache_replacement_policy heap LFUDA
#######################################################
http_access deny all
##############################
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
refresh_pattern . 0 20% 4320
####################################################
#cache_dir rock /CACHE1 20000 max-size=32768 swap-timeout=350
max-swap-rate=350
cache_dir rock /CACHE1 20000 max-size=32768 swap-timeout=350
#####################################
####Slow after sometime tshooting############
memory_pools off
pconn_timeout 2 minutes
persistent_request_timeout 1 minute
#########################
read_ahead_gap 128 KB
###############################################
#####rotating logs#####
logfile_rotate 0

===================================

now i restarted squid and it is fine now ,

i wish to find solution at next time and estimate the reason of that hang

with my best regards

-----
Dr.x

--
View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/after-long-time-squid-hang-no-logs-kill-the-internet-and-i-must-restart-it-tp4663878.html
Sent from the Squid - Users mailing list archive at Nabble.com.
Received on Mon Dec 16 2013 - 11:39:05 MST

This archive was generated by hypermail 2.2.0 : Mon Dec 16 2013 - 12:00:06 MST