[squid-users] Probs with squid 3.4.4 and cache_peer parent

From: <Andreas.Reschke_at_mahle.com>
Date: Mon, 30 Jun 2014 16:34:03 +0200

Hello,

I've setup a internal proxy with squid 3.4.4 on SLES 11 SP3. And with the
same version of squid and OS a proxy in DMZ. The internal proxy crashed
every 5 minutes. I can't find the reason.

2014/06/30 16:09:06 kid1| Set Current Directory to /var/cache/squid
2014/06/30 16:09:06 kid1| Starting Squid Cache version 3.4.4 for
x86_64-suse-linux-gnu...
2014/06/30 16:09:06 kid1| Process ID 31884
2014/06/30 16:09:06 kid1| Process Roles: worker
2014/06/30 16:09:06 kid1| With 40096 file descriptors available
2014/06/30 16:09:06 kid1| Initializing IP Cache...
2014/06/30 16:09:06 kid1| DNS Socket created at 0.0.0.0, FD 8
2014/06/30 16:09:06 kid1| Adding nameserver 194.99.121.30 from squid.conf
2014/06/30 16:09:06 kid1| Adding nameserver 212.121.128.10 from squid.conf
2014/06/30 16:09:06 kid1| Adding nameserver 10.20.94.32 from squid.conf
2014/06/30 16:09:06 kid1| helperOpenServers: Starting 0/200 'squidGuard'
processes
2014/06/30 16:09:06 kid1| helperOpenServers: No 'squidGuard' processes
needed.
2014/06/30 16:09:06 kid1| helperOpenServers: Starting 0/128 'ntlm_auth'
processes
2014/06/30 16:09:06 kid1| helperStatefulOpenServers: No 'ntlm_auth'
processes needed.
2014/06/30 16:09:07 kid1| helperOpenServers: Starting 10/80
'ext_ldap_group_acl' processes
2014/06/30 16:09:07 kid1| Logfile: opening log udp://127.0.0.1:7777
2014/06/30 16:09:07 kid1| Local cache digest enabled; rebuild/rewrite
every 3600/3600 sec
2014/06/30 16:09:07 kid1| Store logging disabled
2014/06/30 16:09:07 kid1| Swap maxSize 0 + 4194304 KB, estimated 322638
objects
2014/06/30 16:09:07 kid1| Target number of buckets: 16131
2014/06/30 16:09:07 kid1| Using 16384 Store buckets
2014/06/30 16:09:07 kid1| Max Mem size: 4194304 KB
2014/06/30 16:09:07 kid1| Max Swap size: 0 KB
2014/06/30 16:09:07 kid1| Using Least Load store dir selection
2014/06/30 16:09:07 kid1| Set Current Directory to /var/cache/squid
2014/06/30 16:09:07 kid1| Finished loading MIME types and icons.
2014/06/30 16:09:07 kid1| HTCP Disabled.
2014/06/30 16:09:07 kid1| Pinger socket opened on FD 34
2014/06/30 16:09:07 kid1| Configuring Parent 194.99.121.200/3128/0
2014/06/30 16:09:07 kid1| Squid plugin modules loaded: 0
2014/06/30 16:09:07 kid1| Adaptation support is on
2014/06/30 16:09:07 kid1| Accepting HTTP Socket connections at
local=0.0.0.0:3128 remote=[::] FD 30 flags=9
2014/06/30 16:09:07 kid1| Accepting SNMP messages on 10.143.153.27:3401
2014/06/30 16:09:07 kid1| Sending SNMP messages from 10.143.153.27:3401
2014/06/30 16:09:07| pinger: Initialising ICMP pinger ...
2014/06/30 16:09:07| icmp_sock: (1) Operation not permitted
2014/06/30 16:09:07| pinger: Unable to start ICMP pinger.
2014/06/30 16:09:07| icmp_sock: (97) Address family not supported by
protocol
2014/06/30 16:09:07| pinger: Unable to start ICMPv6 pinger.
2014/06/30 16:09:07| FATAL: pinger: Unable to open any ICMP sockets.
2014/06/30 16:09:07 kid1| Starting new redirector helpers...
2014/06/30 16:09:07 kid1| helperOpenServers: Starting 1/200 'squidGuard'
processes
2014/06/30 16:09:07 kid1| Starting new redirector helpers...
2014/06/30 16:09:07 kid1| helperOpenServers: Starting 1/200 'squidGuard'
processes
2014/06/30 16:09:07 kid1| recv: (111) Connection refused
2014/06/30 16:09:07 kid1| Closing Pinger socket on FD 34
2014/06/30 16:09:07 kid1| temporary disabling (Forbidden) digest from
194.99.121.200
2014/06/30 16:09:08 kid1| storeLateRelease: released 0 objects
(squid-1)(_Z5deathi+0x49)[0x7f8804808229]
/lib64/libpthread.so.0(+0xf810)[0x7f880410e810]
(squid-1)(_Z19cbdataInternalAlloci+0x27)[0x7f88046aac67]
(squid-1)(_ZN15ServerStateData15startAdaptationERK8RefCountIN10Adaptation12ServiceGroupEEP11HttpRequest+0x250)[0x7f88047ffbf0]
(squid-1)(_ZN15ServerStateData26noteAdaptationAclCheckDoneE8RefCountIN10Adaptation12ServiceGroupEE+0x62)[0x7f88048000a2]
(squid-1)(_ZN12UnaryMemFunTIN10Adaptation9InitiatorE8RefCountINS0_12ServiceGroupEES4_E6doDialEv+0x6a)[0x7f88049240aa]
(squid-1)(_ZN9JobDialerIN10Adaptation9InitiatorEE4dialER9AsyncCall+0x35)[0x7f88049237d5]
(squid-1)(_ZN9AsyncCall4makeEv+0x313)[0x7f8804888e73]
(squid-1)(_ZN14AsyncCallQueue8fireNextEv+0x200)[0x7f880488c4c0]
(squid-1)(_ZN14AsyncCallQueue4fireEv+0x28)[0x7f880488c848]
(squid-1)(_ZN9EventLoop7runOnceEv+0xe4)[0x7f8804716824]
(squid-1)(_ZN9EventLoop3runEv+0x28)[0x7f8804716988]
(squid-1)(_Z9SquidMainiPPc+0x464)[0x7f8804797544]
(squid-1)(+0x25afa9)[0x7f8804797fa9]
/lib64/libc.so.6(__libc_start_main+0xe6)[0x7f8800efcc16]
(squid-1)(+0x13fb09)[0x7f880467cb09]
FATAL: Received Segment Violation...dying.
2014/06/30 16:09:27 kid1| Closing HTTP port 0.0.0.0:3128
2014/06/30 16:09:27 kid1| storeDirWriteCleanLogs: Starting...
2014/06/30 16:09:27 kid1| Finished. Wrote 0 entries.
2014/06/30 16:09:27 kid1| Took 0.00 seconds ( 0.00 entries/sec).
CPU Usage: 0.312 seconds = 0.212 user + 0.100 sys
Maximum Resident Size: 82800 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
        total space in arena: 7244 KB
        Ordinary blocks: 6973 KB 57 blks
        Small blocks: 0 KB 2 blks
        Holding blocks: 23152 KB 6 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 270 KB
        Total in use: 30125 KB 416%
        Total free: 270 KB 4%
2014/06/30 16:09:30 kid1| Set Current Directory to /var/cache/squid

config:
Internal Proxy
bgstproxyls01:~ # cat /etc/squid/squid.conf
#
# Recommended minimum configuration:
#
cache_peer 194.99.121.200 parent 3128 0 no-query default
never_direct allow all

acl snmppublic snmp_community squid
snmp_port 3401
snmp_incoming_address 10.143.153.27
snmp_outgoing_address 10.143.153.27
snmp_access allow all
client_db off
half_closed_clients off
via off
cache_mem 4096 MB
ipcache_size 2028
fqdncache_size 2048

hosts_file /etc/hosts

memory_pools off
maximum_object_size 50 MB
quick_abort_min 0 KB
quick_abort_max 0 KB
log_icp_queries off
buffered_logs on

maximum_object_size 1 KB
maximum_object_size 50 MB

dns_nameservers 194.99.121.30 212.121.128.10
dns_nameservers 10.20.94.32

# Example rule allowing access from your local networks.
# Adapt to list your (internal) IP networks from where browsing
# should be allowed
acl localnet src 10.0.0.0/8 # RFC1918 possible internal network
acl localnet src 172.16.0.0/12 # RFC1918 possible internal network
acl localnet src 192.168.0.0/16 # RFC1918 possible internal network
acl localnet src fc00::/7 # RFC 4193 local private network range
acl localnet src fe80::/10 # RFC 4291 link-local (directly plugged)
machines

acl SSL_ports port 443
acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT
# neu
acl SSL method CONNECT
acl CONNECT method CONNECT

##### erlaubte Seiten ohne Internetberechtigung
acl open-sites dstdomain "/etc/squid/open-sites.txt"
##### erlaubte Seiten ohne Internetberechtigung

##### verbotene Seiten
acl denied-sites url_regex "/etc/squid/denied-sites.txt"
acl selling-sites url_regex "/etc/squid/selling-sites.txt"
acl social-sites url_regex "/etc/squid/social-sites.txt"
##### verbotene Seiten
acl allowedurls dstdomain "/etc/squid/bypass.txt"

external_acl_type LDAPLookup children-startup=10 children-idle=30
children-max=80 ttl=600 negative_ttl=30 %LOGIN
/usr/sbin/ext_ldap_group_acl -d -b "dc=behrgroup,dc=net" -D
"CN=BGST-S-SQUID,OU=Service Accounts,OU=bgst,OU=de,DC=behrgroup,DC=net" -W
/etc/squid/ppp -f
"(&(objectclass=user)(sAMAccountName=%v)(memberof:1.2.840.113556.1.4.1941:=CN=%a,OU=groups,OU=Proxy,OU=Global
Groups,DC=behrgroup,dc=net))" -h 10.20.94.32

#debug_options 28,9

# local & manager
http_access allow manager localhost
http_access deny manager

# nur safe & SSL ab hier
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports

deny_info http://bgstproxyls01/denied.html denied-sites

# Squid normally listens to port 3128
http_port 3128

# We recommend you to use at least the following line.
hierarchy_stoplist cgi-bin ?

# Leave coredumps in the first cache dir
coredump_dir /var/cache/squid

# Add any of your own refresh_pattern entries above these.
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
refresh_pattern . 0 20% 4320

### pure ntlm authentication
auth_param ntlm program /usr/bin/ntlm_auth
--helper-protocol=squid-2.5-ntlmssp --domain=BEHRGROUP.NET
auth_param ntlm children 128
auth_param ntlm keep_alive off

# Zeit-Steuerung für Indien
acl indien proxy_auth external LDAPLookup GGPY-LO-Web-Time-Limited
acl DAY time 05:30-13:30
# Zeit-Steuerung für Indien
acl chkglwebhttp external LDAPLookup GGPY-LO-Web-Http
acl sellingUser external LDAPLookup GGPY-LO-Web-Allowed-Selling
acl socialUser external LDAPLookup GGPY-LO-Web-Allowed-Social
acl allforbUser external LDAPLookup GGPY-LO-Web-Allowed-All
acl ftpputUser external LDAPLookup GGPY-LO-Web-Ftp-Put
acl loggingUser external LDAPLookup GGPY-LO-Web-Log-User
acl auth proxy_auth REQUIRED
# bestimmte IP-adressen erlauben
acl permitt_ips src 10.143.10.247/32
acl FTP proto FTP
acl PUT method PUT

# whitelisten
http_access allow open-sites all
http_access allow localhost
http_access allow permitt_ips !denied-sites !social-sites
http_access allow indien DAY
http_access deny indien
http_access deny !chkglwebhttp
http_access allow selling-sites sellingUser
http_access allow social-sites socialUser

# Denied sites rauswerfen, wenn sie nicht ebenfalls in allforbUser stehen
http_access allow denied-sites allforbUser
http_access deny denied-sites all # tötet alles was in denied-sites steht
und "all" ist; also alles was in denied-sites steht, das all kann
eigenltich weg.

# FTP Regelungen
http_access allow FTP PUT ftpputUser
http_access deny FTP PUT

# Test fuer Feuerecker
http_access allow allowedurls

# Wer nicht in Listen steht, sich aber trotzdem authentifizieren kann darf
durch
http_access allow all auth
http_access allow auth

# Wer hier noch nicht durch ist fliegt raus
http_access deny all

# access_log daemon:/usr/local/squid/var/logs/access.log squid
access_log udp://127.0.0.1:7777 squid

###################
icap_enable on
icap_send_client_ip on
icap_send_client_username on
icap_client_username_encode off
icap_client_username_header X-Authenticated-User
icap_preview_enable on
icap_preview_size 128
#################
## Tred Micro anti virus
icap_service service_1 reqmod_precache bypass=on
icap://10.143.154.23:1344/REQ-Service
icap_service service_2 respmod_precache bypass=on
icap://10.143.154.23:1344/respmod
adaptation_access service_1 allow all
adaptation_access service_2 allow all
adaptation_service_set class_1 service_1
adaptation_service_set class_2 service_2
adaptation_access class_1 allow all
adaptation_access class_2 allow all
## Tred Micro anti virus
redirect_children 20
url_rewrite_program /usr/sbin/squidGuard -c /etc/squidguard.conf
url_rewrite_children 200

External Proxy (DMZ)
bgstproxyls00:/var/log/squid # cat /etc/squid/squid.conf
client_db off
half_closed_clients off
via off
cache_mem 8092 MB
ipcache_size 2028
fqdncache_size 2048

hosts_file /etc/hosts

memory_pools off
maximum_object_size 50 MB
quick_abort_min 0 KB
quick_abort_max 0 KB
log_icp_queries off
buffered_logs on

maximum_object_size 1 KB
maximum_object_size 50 MB

dns_nameservers 194.99.121.30 212.121.128.10
dns_nameservers 10.20.94.32
##### ab hier default
http_port 3128

refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
refresh_pattern . 0 20% 4320

acl localnet src 10.0.0.0/8 # RFC 1918 possible internal network
acl localnet src 172.16.0.0/12 # RFC 1918 possible internal network
acl localnet src 192.168.0.0/16 # RFC 1918 possible internal network
acl localnet src fc00::/7 # RFC 4193 local private network range
acl localnet src fe80::/10 # RFC 4291 link-local (directly plugged)
machines

acl SSL_ports port 443

acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT

http_access allow manager localhost
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports
http_access allow localhost
http_access allow localnet
http_access deny all

access_log daemon:/var/log/squid/squid.log squid

Mit freundlichen Grüßen / Kind regards

Mr. Andreas Reschke
andreas.reschke@mahle.com, http://www.mahle.com
Received on Mon Jun 30 2014 - 14:34:07 MDT

This archive was generated by hypermail 2.2.0 : Tue Jul 01 2014 - 12:00:05 MDT