Re: [squid-users] calling Henrick , Joe ,Adrian ...SOS pls help out.

On 18 Aug 2001 03:54:48 -0700, khiz code wrote:
> Hi all
> i m still waiting for a reply

You may be in the wrong timezone for Jone, Adrian and Henrick. :}.

> pls help me out

I'm guessing here...

> i dont want my bosses to scrap out this squid based
> caching project
> this is a REAL SOS
> rgds
> khizcode
> --- khiz code <khizcode@yahoo.com> wrote:
> > one mor ething
> > ihv got millions of
> > 2001/08/13 10:29:26| clientReadRequest: FD 27: no
> > data
> > to process ((11) Resource temporarily unavailable)

This *shouldn't happen* - we only try to read when the socket is ready.

> > and
> >
> > 2001/08/12 20:18:19| comm_accept: FD 46: (11)

Again, this shouldn't happen, your squid is trying to accept () on a
socket with no pending connections.

Are you using poll or select in your squid. (IIRC you are using linux -
what configure command did you use with squid when you compiled it?).

Also, do you have any firewalling going on with this machine? other than
your ipchains rules?
Do you have any IDS or NIDS software running on the machine or your LAN?
ie snort?

Have you tried testing squid *without transparent operation*. That is,
just in normal mode? It would help to isolate the problem to know if it
is affected at all when you change that.

I've added some other notes below. *note: I'm not a transparent squid
user so I'm not 100% sure of the rules needed - I presume you followed
the squid FAQ in setting the box up though.

> > Resource
> > temporarily unavailable
> > lots of them !!!!
> > what does this signify
> > i had debug level ALL,5
> > giving me a 37 MB cache.log in less than 5 mins
> > would this be of some help
> > ???????

Probably not. It means theres a lot of problems :] What _might_ be of
use is where squid stared to have problems, whether thats 30 seconds or
3 minutes in.

> > rgds
> > khizcode
> > khiz code <khizcode@yahoo.com> wrote:
> > > Hi Joe
> > > i did put the squid box under load for abt 5 mins
> > > and
> > > came up with the same disappointing results
> > > well DNS was responding quickly enuf
> > > howver telnet localhost 3128 from the same box was
> > > taking ages after just 2 mins under load
> > > i am sending u the cachemgr stats which i could
> > > collect immediately after putting off the load (
> > > during load cachemgr too could not connect to
> > squid)
> > >
> > > to clarify i put forth the foll details
> > > 1> compaq prolinea 5500 dual pii xeon 550 Mhz/512
> > mb
> > > ram/6 scsi disk of 9 GB each
> > > RAID 0 done on 4 of the drives and partitioned
> > as
> > > /cache using reiserfs for effective 34 GB
> > > RAID 1 done on the remaining drives where linux is
> > > installed
> > > 2> redhat 6.2 with kernel 2.2.19 and reiserfs 3.53
> > > scsi driver sym 53cxx compiled in . along with
> > > tlan
> > > driver
> > > 3> cache box set up as transparent proxy with
> > > ipchains
> > > target prot opt source
> > > destination ports
> > > ACCEPT all ------ localhost localhost
> >
> > > n/a
> > > REDIRECT tcp ------ anywhere
> > > anywhere
> > > any -> www
> > > => 3128

Won't this rule match squid's outbound connections as well? I would
include the ethernet interface in the rule. (I have a vague memory that
locally generated ipchain packets hit the input rule with a source of lo
- that may be wrong however and local packets not hit the input chain at
all - YMMV.)

> > > ACCEPT all ------ anywhere
> > > anywhere
> > > n/a
> > > Chain forward (policy ACCEPT):
> > > Chain output (policy ACCEPT):

> > > 4> squid.conf
> > > cache_mem 128 MB
> > > maximum_object_size 40960 KB
> > > cache_dir /cache 10000 30 25

This line *seem* strange. However it shouldn't affect poll/select and
accept :]

> > > dns_children 15
> > > httpd_accel_host virtual
> > > httpd_accel_port 80
> > > httpd_accel_with_proxy on
> > > httpd_accel_uses_host_header on
> > > memory_pools_limit 70 MB
> > > 5> glibc-2.1.3-22
> > >
> > > STATISTICS------
> > > CAHE RUN TIME
> > > Connection information for squid:
> > > Number of clients accessing cache: 40
> > > Number of HTTP requests received: 4168
> > > Number of ICP messages received: 0
> > > Number of ICP messages sent: 0
> > > Number of queued ICP replies: 0
> > > Request failure ratio: 0.00%
> > > HTTP requests per minute: 94.7
> > > ICP messages per minute: 0.0
> > > Select loop called: 187023 times, 14.120 ms avg
> > > Cache information for squid:
> > > Request Hit Ratios: 5min: 10.1%, 60min: 6.3%
> > > Byte Hit Ratios: 5min: 23.0%, 60min: 20.0%
> > > Storage Swap size: 6182 KB
> > > Storage Mem size: 3004 KB
> > > Storage LRU Expiration Age: 365.00 days
> > > Mean Object Size: 8.63 KB
> > > Requests given to unlinkd: 21
> > > Median Service Times (seconds) 5 min 60 min:
> > > HTTP Requests (All): 0.01648 0.02899
> > > Cache Misses: 0.61549 0.58309
> > > Cache Hits: 0.00598 0.00562
> > > Near Hits: 0.04776 0.04047
> > > Not-Modified Replies: 0.00678 0.00562
> > > DNS Lookups: 0.01210 0.01269
> > > ICP Queries: 0.00000 0.00000
> > > Resource usage for squid:
> > > UP Time: 2640.817 seconds
> > > CPU Time: 76.890 seconds
> > > CPU Usage: 2.91%
> > > CPU Usage, 5 minute avg: 17.93%
> > > CPU Usage, 60 minute avg: 2.91%
> > > Maximum Resident Size: 0 KB
> > > Page faults with physical i/o: 334
> > > Memory usage for squid via mallinfo():
> > > Total space in arena: 15266 KB
> > > Ordinary blocks: 14696 KB 537 blks
> > > Small blocks: 0 KB 0 blks
> > > Holding blocks: 2952 KB 2 blks
> > > Free Small blocks: 0 KB
> > > Free Ordinary blocks: 570 KB
> > > Total in use: 17648 KB 116%
> > > Total free: 570 KB 4%
> > > Memory accounted for:
> > > Total accounted: 4126 KB
> > > File descriptor usage for squid:
> > > Maximum number of file descriptors: 16384
> > > Largest file desc currently in use: 251
> > > Number of file desc currently in use: 83
> > > Files queued for open: 0
> > > Available number of file descriptors: 16301
> > > Reserved number of file descriptors: 100
> > > Store Disk files open: 1
> > > Internal Data Structures:
> > > 740 StoreEntries
> > > 656 StoreEntries with MemObjects
> > > 650 Hot Object Cache Items
> > > 717 Filemap bits set
> > > 716 on-disk objects
> > > ===============================================
> > > ASYNC IO Counters:
> > >
> > > open 753
> > > close 1
> > > cancel 8413
> > > write 0
> > > read 47
> > > stat 0
> > > unlink 1
> > > check_callback 190484
> > > queue 0
> > > ================================================
> > > sample_start_time = 997626385.518401 (Sun, 12 Aug
> > > 2001
> > > 14:26:25 GMT)
> > > sample_end_time = 997626685.573941 (Sun, 12 Aug
> > 2001
> > > 14:31:25 GMT)
> > > client_http.requests = 3.306055/sec
> > > client_http.hits = 0.356601/sec
> > > client_http.errors = 0.000000/sec
> > > client_http.kbytes_in = 2.312905/sec
> > > client_http.kbytes_out = 8.331791/sec
> > > client_http.all_median_svc_time = 0.016481 seconds
> > > client_http.miss_median_svc_time = 0.615488
> > seconds
> > > client_http.nm_median_svc_time = 0.006779 seconds
> > > client_http.nh_median_svc_time = 0.030657 seconds
> > > client_http.hit_median_svc_time = 0.006779 seconds
> > > server.all.requests = 1.563044/sec
> > > server.all.errors = 0.000000/sec
> > > server.all.kbytes_in = 6.195520/sec
> > > server.all.kbytes_out = 0.833179/sec
> > > server.http.requests = 1.563044/sec
> > > server.http.errors = 0.000000/sec
> > > server.http.kbytes_in = 6.195520/sec
> > > server.http.kbytes_out = 0.833179/sec
> > > server.ftp.requests = 0.000000/sec
> > > server.ftp.errors = 0.000000/sec
> > > server.ftp.kbytes_in = 0.000000/sec
> > > server.ftp.kbytes_out = 0.000000/sec
> > > server.other.requests = 0.000000/sec
> > > server.other.errors = 0.000000/sec
> > > server.other.kbytes_in = 0.000000/sec
> > > server.other.kbytes_out = 0.000000/sec
> > > icp.pkts_sent = 0.000000/sec
> > > icp.pkts_recv = 0.000000/sec
> > > icp.queries_sent = 0.000000/sec
> > > icp.replies_sent = 0.000000/sec
> > > icp.queries_recv = 0.000000/sec
> > > icp.replies_recv = 0.000000/sec
> > > icp.replies_queued = 0.000000/sec
> > > icp.query_timeouts = 0.000000/sec
> > > icp.kbytes_sent = 0.000000/sec
> > > icp.kbytes_recv = 0.000000/sec
> > > icp.q_kbytes_sent = 0.000000/sec
> > > icp.r_kbytes_sent = 0.000000/sec
> > > icp.q_kbytes_recv = 0.000000/sec
> > > icp.r_kbytes_recv = 0.000000/sec
> > > icp.query_median_svc_time = 0.000000 seconds
> > > icp.reply_median_svc_time = 0.000000 seconds
> > > dns.median_svc_time = 0.009036 seconds
> > > unlink.requests = 0.019996/sec
> > > page_faults = 0.000000/sec
> > > select_loops = 74.712835/sec
> > > select_fds = 28.151455/sec
> >
> === message truncated ===
>
>
> __________________________________________________
> Do You Yahoo!?
> Make international calls for as low as $.04/minute with Yahoo! Messenger
> http://phonecard.yahoo.com/
Received on Sat Aug 18 2001 - 05:58:34 MDT