[squid-users] download rates w/ squid

From: Gregori Parker <gregori@dont-contact.us>
Date: Wed, 3 May 2006 16:11:05 -0700

Once again, I'm using squid as an http-accelerator...

Squid seems to be capping rate of transfer to around 80 KB/s...I'm doing this transfer locally from one squid box to another via wget.  If I do this same transfer using scp, I get around 90 MB/s sustained.  I'm also noticing drastic fluctuations in speed when downloading from squid...every once in awhile it will jump up to 300 KB/s, but then fall back down to around 80 KB/s again.

I have eliminated the network, hardware and server configuration as potential problems -- I'm 99.8% sure it's squid.

Does anyone have any ideas as to why squid is having trouble filling the pipe?

Here's my trimmed down conf file......
------------------------------------------------------

http_port 80
icp_port 0
# no cache_peer entries
cache_mem 256 MB
cache_swap_low 90
cache_swap_high 98
maximum_object_size 256 MB
maximum_object_size_in_memory 1024 KB
cache_replacement_policy lru
memory_replacement_policy lru
cache_dir aufs /cache0/c0 40960 16 256
cache_dir aufs /cache0/c1 40960 16 256
# ...etc, 12 in total
cache_access_log /usr/local/squid/var/logs/access.log
cache_log /usr/local/squid/var/logs/cache.log
cache_store_log none
emulate_httpd_log on
pid_filename /var/run/squid.pid
debug_options ALL,1

redirect_program /usr/local/squid/redir.pl
redirect_children 20
redirect_rewrites_host_header off
refresh_pattern . 0 0% 4320
half_closed_clients off
shutdown_lifetime 4 seconds

# ACCESS CONTROLS (simplified)
acl all src 0.0.0.0/0.0.0.0
acl origins dst xx.xxx.xxx.x/255.255.255.192
acl acceleratedPort port 80
http_access allow all
http_access allow origins acceleratedPort
http_reply_access allow all

httpd_accel_port 80
httpd_accel_host my.accelerated.hostname.com
httpd_accel_single_host on
httpd_accel_with_proxy off
httpd_accel_uses_host_header off

logfile_rotate 0
log_icp_queries off
icp_hit_stale on
client_db off
snmp_port 161
acl SNMPPasswd snmp_community nottherealstring
acl SNMPClient1 src xxx.xxx.xxx.xx/255.255.255.255
acl SNMPClient2 src xxx.xxx.xxx.xx/255.255.255.255
snmp_access allow SNMPClient1 SNMPPasswd
snmp_access allow SNMPClient2 SNMPPasswd
snmp_access deny all
uri_whitespace allow
strip_query_terms off
relaxed_header_parser warn
Received on Wed May 03 2006 - 17:11:05 MDT

This archive was generated by hypermail pre-2.1.9 : Thu Jun 01 2006 - 12:00:01 MDT