[squid-users] Advice on performance

From: squid squid <squidusr@dont-contact.us>
Date: Wed, 01 Jun 2005 19:09:37 +0800

The general info and squid.conf for my 4 squid servers as follows:

Pls advise how is their performance and any tuning needed in order to have
better performance.

Thank you.
[root@squidsvr1 bin]# ./squidclient mgr:info
HTTP/1.0 200 OK
Server: squid/2.5.STABLE10
Mime-Version: 1.0
Date: Wed, 01 Jun 2005 10:35:05 GMT
Content-Type: text/plain
Expires: Wed, 01 Jun 2005 10:35:05 GMT
Last-Modified: Wed, 01 Jun 2005 10:35:05 GMT
X-Cache: MISS from squidsvr1.inet
Proxy-Connection: close

Squid Object Cache: Version 2.5.STABLE10
Start Time: Tue, 31 May 2005 16:00:42 GMT
Current Time: Wed, 01 Jun 2005 10:35:05 GMT
Connection information for squid:
        Number of clients accessing cache: 0
        Number of HTTP requests received: 1124902
        Number of ICP messages received: 0
        Number of ICP messages sent: 0
        Number of queued ICP replies: 0
        Request failure ratio: 0.00
        Average HTTP requests per minute since start: 1009.4
        Average ICP messages per minute since start: 0.0
        Select loop called: 11453706 times, 5.838 ms avg
Cache information for squid:
        Request Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Byte Hit Ratios: 5min: 0.8%, 60min: 0.5%
        Request Memory Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Request Disk Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Storage Swap size: 0 KB
        Storage Mem size: 4 KB
        Mean Object Size: 0.00 KB
        Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
        HTTP Requests (All): 0.02592 0.02742
        Cache Misses: 0.02592 0.02899
        Cache Hits: 0.00000 0.00000
        Near Hits: 0.00000 0.00000
        Not-Modified Replies: 0.00000 0.00000
        DNS Lookups: 0.00094 0.00190
        ICP Queries: 0.00000 0.00000
Resource usage for squid:
        UP Time: 66862.278 seconds
        CPU Time: 2567.370 seconds
        CPU Usage: 3.84%
        CPU Usage, 5 minute avg: 0.76%
        CPU Usage, 60 minute avg: 2.23%
        Process Data Segment Size via sbrk(): 29949 KB
        Maximum Resident Size: 0 KB
        Page faults with physical i/o: 330
Memory usage for squid via mallinfo():
        Total space in arena: 29949 KB
        Ordinary blocks: 10648 KB 5588 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 1572 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 19300 KB
        Total in use: 12220 KB 39%
        Total free: 19300 KB 61%
        Total size: 31521 KB
Memory accounted for:
        Total accounted: 7140 KB
        memPoolAlloc calls: 131246012
        memPoolFree calls: 131205714
File descriptor usage for squid:
        Maximum number of file descriptors: 8192
        Largest file desc currently in use: 122
        Number of file desc currently in use: 41
        Files queued for open: 0
        Available number of file descriptors: 8151
        Reserved number of file descriptors: 100
        Store Disk files open: 0
Internal Data Structures:
             3 StoreEntries
             3 StoreEntries with MemObjects
             0 Hot Object Cache Items
             0 on-disk objects

root@squidsvr2 ==> ./squidclient mgr:info
HTTP/1.0 200 OK
Server: squid/2.5.STABLE10
Mime-Version: 1.0
Date: Wed, 01 Jun 2005 10:37:12 GMT
Content-Type: text/plain
Expires: Wed, 01 Jun 2005 10:37:12 GMT
Last-Modified: Wed, 01 Jun 2005 10:37:12 GMT
X-Cache: MISS from squidsvr2.inet
Proxy-Connection: close

Squid Object Cache: Version 2.5.STABLE10
Start Time: Tue, 31 May 2005 20:20:14 GMT
Current Time: Wed, 01 Jun 2005 10:37:12 GMT
Connection information for squid:
        Number of clients accessing cache: 0
        Number of HTTP requests received: 3172930
        Number of ICP messages received: 0
        Number of ICP messages sent: 0
        Number of queued ICP replies: 0
        Request failure ratio: 0.00
        Average HTTP requests per minute since start: 3702.5
        Average ICP messages per minute since start: 0.0
        Select loop called: 2748567 times, 18.707 ms avg
Cache information for squid:
        Request Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Byte Hit Ratios: 5min: 0.3%, 60min: 0.2%
        Request Memory Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Request Disk Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Storage Swap size: 0 KB
        Storage Mem size: 88 KB
        Mean Object Size: 0.00 KB
        Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
        HTTP Requests (All): 0.03066 0.03427
        Cache Misses: 0.03066 0.03427
        Cache Hits: 0.00000 0.00000
        Near Hits: 0.00000 0.00000
        Not-Modified Replies: 0.00000 0.00000
        DNS Lookups: 0.01269 0.02033
        ICP Queries: 0.00000 0.00000
Resource usage for squid:
        UP Time: 51418.451 seconds
        CPU Time: 28646.970 seconds
        CPU Usage: 55.71%
        CPU Usage, 5 minute avg: 22.27%
        CPU Usage, 60 minute avg: 44.94%
        Process Data Segment Size via sbrk(): 16896 KB
        Maximum Resident Size: 0 KB
        Page faults with physical i/o: 80
Memory accounted for:
        Total accounted: 4232 KB
        memPoolAlloc calls: 375967247
        memPoolFree calls: 375944709
File descriptor usage for squid:
        Maximum number of file descriptors: 1024
        Largest file desc currently in use: 224
        Number of file desc currently in use: 83
        Files queued for open: 0
        Available number of file descriptors: 941
        Reserved number of file descriptors: 100
        Store Disk files open: 0
Internal Data Structures:
            24 StoreEntries
            24 StoreEntries with MemObjects
            21 Hot Object Cache Items
             0 on-disk objects

[root@squidsvr3 bin]# ./squidclient mgr:info
HTTP/1.0 200 OK
Server: squid/2.5.STABLE10
Mime-Version: 1.0
Date: Wed, 01 Jun 2005 10:38:43 GMT
Content-Type: text/plain
Expires: Wed, 01 Jun 2005 10:38:43 GMT
Last-Modified: Wed, 01 Jun 2005 10:38:43 GMT
X-Cache: MISS from squidsvr3.inet
Proxy-Connection: close

Squid Object Cache: Version 2.5.STABLE10
Start Time: Tue, 31 May 2005 16:00:32 GMT
Current Time: Wed, 01 Jun 2005 10:38:43 GMT
Connection information for squid:
        Number of clients accessing cache: 0
        Number of HTTP requests received: 128015
        Number of ICP messages received: 0
        Number of ICP messages sent: 0
        Number of queued ICP replies: 0
        Request failure ratio: 0.00
        Average HTTP requests per minute since start: 114.5
        Average ICP messages per minute since start: 0.0
        Select loop called: 1773334 times, 37.833 ms avg
Cache information for squid:
        Request Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Byte Hit Ratios: 5min: 0.2%, 60min: 0.3%
        Request Memory Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Request Disk Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Storage Swap size: 0 KB
        Storage Mem size: 60 KB
        Mean Object Size: 0.00 KB
        Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
        HTTP Requests (All): 0.04277 0.03622
        Cache Misses: 0.04277 0.03622
        Cache Hits: 0.00000 0.00000
        Near Hits: 0.00000 0.00000
        Not-Modified Replies: 0.00000 0.00000
        DNS Lookups: 0.00203 0.00278
        ICP Queries: 0.00000 0.00000
Resource usage for squid:
        UP Time: 67090.694 seconds
        CPU Time: 98.530 seconds
        CPU Usage: 0.15%
        CPU Usage, 5 minute avg: 0.10%
        CPU Usage, 60 minute avg: 0.09%
        Process Data Segment Size via sbrk(): 2093 KB
        Maximum Resident Size: 0 KB
        Page faults with physical i/o: 329
Memory usage for squid via mallinfo():
        Total space in arena: 2093 KB
        Ordinary blocks: 1779 KB 75 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 1572 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 313 KB
        Total in use: 3351 KB 91%
        Total free: 313 KB 9%
        Total size: 3665 KB
Memory accounted for:
        Total accounted: 126 KB
        memPoolAlloc calls: 15819317
        memPoolFree calls: 15818283
File descriptor usage for squid:
        Maximum number of file descriptors: 8192
        Largest file desc currently in use: 12
        Number of file desc currently in use: 9
        Files queued for open: 0
        Available number of file descriptors: 8183
        Reserved number of file descriptors: 100
        Store Disk files open: 0
Internal Data Structures:
             2 StoreEntries
             2 StoreEntries with MemObjects
             0 Hot Object Cache Items
             0 on-disk objects

[root@squidsvr4 bin]# ./squidclient mgr:info
HTTP/1.0 200 OK
Server: squid/2.5.STABLE10
Mime-Version: 1.0
Date: Wed, 01 Jun 2005 10:44:10 GMT
Content-Type: text/plain
Expires: Wed, 01 Jun 2005 10:44:10 GMT
Last-Modified: Wed, 01 Jun 2005 10:44:10 GMT
X-Cache: MISS from squidsvr4.inet
Proxy-Connection: close

Squid Object Cache: Version 2.5.STABLE10
Start Time: Tue, 31 May 2005 21:03:40 GMT
Current Time: Wed, 01 Jun 2005 10:44:10 GMT
Connection information for squid:
        Number of clients accessing cache: 0
        Number of HTTP requests received: 4263830
        Number of ICP messages received: 0
        Number of ICP messages sent: 0
        Number of queued ICP replies: 0
        Request failure ratio: 0.00
        Average HTTP requests per minute since start: 5196.5
        Average ICP messages per minute since start: 0.0
        Select loop called: 26976692 times, 1.825 ms avg
Cache information for squid:
        Request Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Byte Hit Ratios: 5min: 0.5%, 60min: 3.0%
        Request Memory Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Request Disk Hit Ratios: 5min: 0.0%, 60min: 0.0%
        Storage Swap size: 0 KB
        Storage Mem size: 104 KB
        Mean Object Size: 0.00 KB
        Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
        HTTP Requests (All): 0.03829 0.03427
        Cache Misses: 0.03829 0.04277
        Cache Hits: 0.00000 0.00000
        Near Hits: 0.00000 0.00000
        Not-Modified Replies: 0.00000 0.00000
        DNS Lookups: 0.00094 0.00094
        ICP Queries: 0.00000 0.00000
Resource usage for squid:
        UP Time: 49230.702 seconds
        CPU Time: 18375.180 seconds
        CPU Usage: 37.32%
        CPU Usage, 5 minute avg: 2.66%
        CPU Usage, 60 minute avg: 12.74%
        Process Data Segment Size via sbrk(): 38485 KB
        Maximum Resident Size: 0 KB
        Page faults with physical i/o: 342
Memory usage for squid via mallinfo():
        Total space in arena: 38485 KB
        Ordinary blocks: 22329 KB 19322 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 1572 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 16155 KB
        Total in use: 23901 KB 60%
        Total free: 16155 KB 40%
        Total size: 40057 KB
Memory accounted for:
        Total accounted: 15396 KB
        memPoolAlloc calls: 489617521
        memPoolFree calls: 489531536
File descriptor usage for squid:
        Maximum number of file descriptors: 8192
        Largest file desc currently in use: 117
        Number of file desc currently in use: 101
        Files queued for open: 0
        Available number of file descriptors: 8091
        Reserved number of file descriptors: 100
        Store Disk files open: 0
Internal Data Structures:
            28 StoreEntries
            28 StoreEntries with MemObjects
            25 Hot Object Cache Items
             0 on-disk objects

Squid.conf (identical for all servers)
# NETWORK OPTIONS
http_port 3128
icp_port 0

# OPTIONS WHICH AFFECT THE CACHE SIZE
cache_mem 10 MB
maximum_object_size 1024 KB
maximum_object_size_in_memory 1024 KB

# LOGFILE PATHNAMES & CACHE DIRECTORIES
# Setting for null storage to avoid having a cache directory
logformat MINDEF %>a %ul %un [%tl] "%rm %ru HTTP/%rv" %Hs %<st %Ss:%Sh %tr
cache_dir null /export/home/log/squid/null
cache_access_log /export/home/log/squid/access.log MINDEF
cache_log /export/home/log/squid/cache.log
cache_store_log none
#emulate_httpd_log on
log_ip_on_direct off
mime_table /usr/local/squid/etc/mime.conf
log_mime_hdrs off
pid_filename /export/home/log/squid/squid.pid
debug_options ALL,1
log_fqdn off

# OPTIONS FOR EXTERNAL SUPPORT PROGRAMS
hosts_file /etc/hosts

# OPTIONS FOR TUNING THE CACHE
request_header_max_size 5 KB
negative_ttl 5 minutes
positive_dns_ttl 30 minutes
negative_dns_ttl 1 minutes

# TIMEOUTS
connect_timeout 120 seconds
peer_connect_timeout 120 seconds
read_timeout 5 minutes
request_timeout 5 minutes
half_closed_clients off
pconn_timeout 15 seconds
shutdown_lifetime 10 seconds

# HTTPD-ACCELERATOR OPTIONS
# For Squid to run as transparent proxy
httpd_accel_uses_host_header on

# MISCELLANEOUS

memory_pools off
cachemgr_passwd none all
snmp_port 0
client_db off

_________________________________________________________________
Keep track of Singapore & Malaysia stock prices.
http://www.msn.com.sg/money/
Received on Wed Jun 01 2005 - 05:09:38 MDT

This archive was generated by hypermail pre-2.1.9 : Fri Jul 01 2005 - 12:00:02 MDT