Hi all
i would like to emphasize that i am getting
2001/08/15 14:23:53| clientReadRequest: FD 21: no data to process ((11)
Resource temporarily unavailable) after almost every get request (
with and without load)
the cpu and memory are hardly utilsed at load
under load of less than 10 req /sec it takes me abt 2 mins to telnet to
the squid port even from the same
machine as squid
vmstat under load
STATISTICS under load of less than 10req/sec
vmstat
procs memory swap io systm cpu
r b w swpd free buff cache si so bi bo in cs us sy id
0 0 0 0 219812 217796 27548 0 0 0 1 53 53 0 0
100
======================================
strace o/p without load
% time seconds usecs/call calls errors syscall
------ ----------- ----------- --------- --------- ----------------
81.96 0.150849 234 645 poll
4.55 0.008374 465 18 open
2.84 0.005230 36 145 write
2.62 0.004815 5 885 gettimeofday
2.02 0.003719 5 693 628 msgrcv
1.53 0.002808 14 194 28 read
1.32 0.002437 25 96 48 accept
1.01 0.001862 25 74 close
0.78 0.001431 6 222 fcntl
0.71 0.001314 20 65 msgsnd
0.26 0.000477 13 36 getdents
0.15 0.000267 6 48 getsockname
0.07 0.000130 43 3 3 connect
0.06 0.000102 6 18 fstat
0.05 0.000091 30 3 socket
0.03 0.000048 48 1 sendto
0.02 0.000039 13 3 getsockopt
0.01 0.000021 5 4 getrusage
0.01 0.000020 7 3 setsockopt
0.01 0.000015 15 1 recvfrom
------ ----------- ----------- --------- --------- ----------------
100.00 0.184049
=================================================================
i am repaeting all the details here
1> compaq prolinea 5500 dual pii xeon 550 Mhz/512 mb
ram/6 scsi disk of 9 GB each
RAID 0 done on 4 of the drives and partitioned as
/cache using reiserfs for effective 34 GB
RAID 1 done on the remaining drives where linux is
installed
2> redhat 6.2 with kernel 2.2.19 and reiserfs 3.53
scsi driver sym 53cxx compiled in . along with tlan
driver
3> cache box set up as transparent proxy with ipchains
target prot opt source
destination ports
ACCEPT all ------ localhost localhost
n/a
REDIRECT tcp ------ anywhere anywhere
any -> www
=> 3128
ACCEPT all ------ anywhere anywhere
n/a
Chain forward (policy ACCEPT):
Chain output (policy ACCEPT):
4> squid.conf
cache_mem 128 MB
maximum_object_size 40960 KB
cache_dir /cache 10000 30 25
dns_children 15
httpd_accel_host virtual
httpd_accel_port 80
httpd_accel_with_proxy on
httpd_accel_uses_host_header on
memory_pools_limit 70 MB
5> glibc-2.1.3-22
6> ipchains 1.3.9 17-Mar-1999
7> Filesystem Size Used Avail Use% Mounted on
/dev/ida/c0d0p9 486M 56M 405M 12% /
/dev/ida/c0d0p1 486M 7.5M 454M 2% /boot
/dev/ida/c0d1p1 34G 298M 34G 1% /cache
/dev/ida/c0d0p7 1.6G 279M 1.2G 18% /home
/dev/ida/c0d0p5 2.9G 1.3G 1.5G 47% /usr
/dev/ida/c0d0p6 1.9G 13M 1.8G 1% /va
8> /var/log/dmesg has an entry saying that
mtrr: your CPUs had inconsistent fixed MTRR settings
mtrr: probably your BIOS does not setup all CPUs
is this okay ???
9> startup scripts
echo 1 >/proc/sys/net/ipv4/ip_forward
ulimit -HSn 16384
echo 10000 > /proc/sys/fs/file-max
echo 32768 >/proc/sys/fs/inode-max
echo 1024 65000 /proc/sys/net/ipv4/ip_local_port_range
echo 1024 > /proc/sys/net/ipv4/tcp_max_syn_backlog
echo 100 > /proc/sys/net/ipv4/tcp_fin_timeout
echo 300 > /proc/sys/net/ipv4/tcp_keepalive_time
echo 0 > /proc/sys/net/ipv4/tcp_sack
echo 0 > /proc/sys/net/ipv4/tcp_timestamp
CAHE RUN TIME
Connection information for squid:
Number of clients accessing cache: 40
Number of HTTP requests received: 4168
Number of ICP messages received: 0
Number of ICP messages sent: 0
Number of queued ICP replies: 0
Request failure ratio: 0.00%
HTTP requests per minute: 94.7
ICP messages per minute: 0.0
Select loop called: 187023 times, 14.120 ms avg
Cache information for squid:
Request Hit Ratios: 5min: 10.1%, 60min: 6.3%
Byte Hit Ratios: 5min: 23.0%, 60min: 20.0%
Storage Swap size: 6182 KB
Storage Mem size: 3004 KB
Storage LRU Expiration Age: 365.00 days
Mean Object Size: 8.63 KB
Requests given to unlinkd: 21
Median Service Times (seconds) 5 min 60 min:
HTTP Requests (All): 0.01648 0.02899
Cache Misses: 0.61549 0.58309
Cache Hits: 0.00598 0.00562
Near Hits: 0.04776 0.04047
Not-Modified Replies: 0.00678 0.00562
DNS Lookups: 0.01210 0.01269
ICP Queries: 0.00000 0.00000
Resource usage for squid:
UP Time: 2640.817 seconds
CPU Time: 76.890 seconds
CPU Usage: 2.91%
CPU Usage, 5 minute avg: 17.93%
CPU Usage, 60 minute avg: 2.91%
Maximum Resident Size: 0 KB
Page faults with physical i/o: 334
Memory usage for squid via mallinfo():
Total space in arena: 15266 KB
Ordinary blocks: 14696 KB 537 blks
Small blocks: 0 KB 0 blks
Holding blocks: 2952 KB 2 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 570 KB
Total in use: 17648 KB 116%
Total free: 570 KB 4%
Memory accounted for:
Total accounted: 4126 KB
File descriptor usage for squid:
Maximum number of file descriptors: 16384
Largest file desc currently in use: 251
Number of file desc currently in use: 83
Files queued for open: 0
Available number of file descriptors: 16301
Reserved number of file descriptors: 100
Store Disk files open: 1
Internal Data Structures:
740 StoreEntries
656 StoreEntries with MemObjects
650 Hot Object Cache Items
717 Filemap bits set
716 on-disk objects
===============================================
ASYNC IO Counters:
open 753
close 1
cancel 8413
write 0
read 47
stat 0
unlink 1
check_callback 190484
queue 0
================================================
sample_start_time = 997626385.518401 (Sun, 12 Aug 2001
14:26:25 GMT)
sample_end_time = 997626685.573941 (Sun, 12 Aug 2001
14:31:25 GMT)
client_http.requests = 3.306055/sec
client_http.hits = 0.356601/sec
client_http.errors = 0.000000/sec
client_http.kbytes_in = 2.312905/sec
client_http.kbytes_out = 8.331791/sec
client_http.all_median_svc_time = 0.016481 seconds
client_http.miss_median_svc_time = 0.615488 seconds
client_http.nm_median_svc_time = 0.006779 seconds
client_http.nh_median_svc_time = 0.030657 seconds
client_http.hit_median_svc_time = 0.006779 seconds
server.all.requests = 1.563044/sec
server.all.errors = 0.000000/sec
server.all.kbytes_in = 6.195520/sec
server.all.kbytes_out = 0.833179/sec
server.http.requests = 1.563044/sec
server.http.errors = 0.000000/sec
server.http.kbytes_in = 6.195520/sec
server.http.kbytes_out = 0.833179/sec
server.ftp.requests = 0.000000/sec
server.ftp.errors = 0.000000/sec
server.ftp.kbytes_in = 0.000000/sec
server.ftp.kbytes_out = 0.000000/sec
server.other.requests = 0.000000/sec
server.other.errors = 0.000000/sec
server.other.kbytes_in = 0.000000/sec
server.other.kbytes_out = 0.000000/sec
icp.pkts_sent = 0.000000/sec
icp.pkts_recv = 0.000000/sec
icp.queries_sent = 0.000000/sec
icp.replies_sent = 0.000000/sec
icp.queries_recv = 0.000000/sec
icp.replies_recv = 0.000000/sec
icp.replies_queued = 0.000000/sec
icp.query_timeouts = 0.000000/sec
icp.kbytes_sent = 0.000000/sec
icp.kbytes_recv = 0.000000/sec
icp.q_kbytes_sent = 0.000000/sec
icp.r_kbytes_sent = 0.000000/sec
icp.q_kbytes_recv = 0.000000/sec
icp.r_kbytes_recv = 0.000000/sec
icp.query_median_svc_time = 0.000000 seconds
icp.reply_median_svc_time = 0.000000 seconds
dns.median_svc_time = 0.009036 seconds
unlink.requests = 0.019996/sec
page_faults = 0.000000/sec
select_loops = 74.712835/sec
select_fds = 28.151455/sec
average_select_fd_period = 0.003573/fd
median_select_fds = 0.000000
swap_files_cleaned = 0.000000/sec
aborted_requests = 0.156638/sec
syscalls.polls = 77.532313/sec
syscalls.disk.opens = 0.526569/sec
syscalls.disk.closes = 0.526569/sec
syscalls.disk.reads = 0.026662/sec
syscalls.disk.writes = 5.079060/sec
syscalls.disk.seeks = 0.000000/sec
syscalls.disk.unlinks = 0.000000/sec
syscalls.sock.accepts = 4.705795/sec
syscalls.sock.sockets = 0.876504/sec
syscalls.sock.connects = 0.876504/sec
syscalls.sock.binds = 0.000000/sec
syscalls.sock.closes = 3.655990/sec
syscalls.sock.reads = 13.270876/sec
syscalls.sock.writes = 10.364748/sec
syscalls.sock.recvfroms = 0.003333/sec
syscalls.sock.sendtos = 0.000000/sec
cpu_time = 51.140000 seconds
wall_time = 300.055540 seconds
cpu_usage = 17.043511%
=================================================
DNS stats
# FD # Requests Flags Time Offset Request
1 4 192 A 412.527 0 (none)
2 7 33 A 454.254 0 (none)
3 8 12 A 1107.534 0 (none)
4 9 2 A 1107.520 0 (none)
5 10 0 A 1194505.417 0 (none)
6 11 0 A 1194505.417 0 (none)
7 12 0 A 1194505.417 0 (none)
8 13 0 A 1194505.417 0 (none)
9 14 0 A 1194505.417 0 (none)
10 15 0 A 1194505.417 0 (none)
11 16 0 A 1194505.417 0 (none)
12 17 0 A 1194505.417 0 (none)
13 18 0 A 1194505.417 0 (none)
14 19 0 A 1194505.417 0 (none)
15 20 0 A 1194505.417 0 (none)
plez help out
rgds
khizcode
P.S i m not a spammer.. these repeated mails r a sign of desperation
===========================================
--- "Garner, Robin" <Robin.Garner@crsrehab.gov.au> wrote:
> Hi,
>
> Maybe I can help.
>
> How much memory does your machine have ? What are your cache_mem and
> cache_dir settings.
>
> Can you run 'top' ? What does it say ?
>
> Regards,
>
> > -----Original Message-----
> > From: khiz code [mailto:khizcode@yahoo.com]
> > Sent: Monday, 20 August 2001 17:44
> > To: joe@swelltech.com; squid-users@squid-cache.org;
> > wojtek@wojtek.3miasto.net; adrian@squid-cache.org;
> hno@hem.passagen.se
> > Subject: Re: [squid-users] calling Henrick , Joe ,Adrian
> > ...SOS pls help
> > out
> >
> >
>
__________________________________________________
Do You Yahoo!?
Make international calls for as low as $.04/minute with Yahoo! Messenger
http://phonecard.yahoo.com/
Received on Mon Aug 20 2001 - 03:29:01 MDT
This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 17:01:44 MST