[squid-users] storeurl_rewrite issues

Hey there!

I'm having some troubles with the storeurl_rewrite functionality in Squid.

Basic problem:
I am successfully able to run the external rewrite program, and a valid value is returned to Squid (as evidenced in cache.log), but then Squid just hangs, and never does any cache lookups or fetches to the URLs (access.log never gets written to).  Is there a step in which I have to pass the results somewhere in order for the processing to continue?

When I turn off the storeurl_rewrite program, everything works fine.  I receive TCP_HITs and TCP_MISSes (as expected) for the various URLs that I am trying to hit.  However, when I turn on the storeurl_rewrite (i.e., modify the config), I see the problems stated above.

A little more detail:
I am using Squid locally to cache external requests made by an application that I have. This app runs on Tomcat 5.5, which is set it up to route through Squid.  Essentially, the application makes calls to 3rd parties (with dynamic parameters in the URL), and I want to be able to slightly modify these calls so that the dynamic parameters do not cause new entries to be created in Squid.

One thing I noticed is that the HTTP Request File Descriptors are not closing (see last line of the log file).  I tried modifying the config to close these (half_closed_clients off), but that didn't seem to help.  I also tried modifying the storeurl_children parameter, but that didn't help either.

Any help is greatly appreciated.  Thanks!
Mark

Some logging info:

2008/07/11 14:57:45| ipc(php.exe,3264): received from parent: http://mysite.com?parameters&more_parameters
2008/07/11 14:57:45| cbdataUnlock: 003BF168
2008/07/11 14:57:45| comm_select: timeout 547
2008/07/11 14:57:45| ipc(php.exe,3264): received from child : http://mysite.com?parameters&modified_parameters
2008/07/11 14:57:45| comm_call_handlers(): got fd=6 read_event=1 write_event=0 F->read_handler=00447E4F F->write_handler=00000000
2008/07/11 14:57:45| comm_call_handlers(): Calling read handler on fd=6
2008/07/11 14:57:45| cbdataValid: 003BF168
2008/07/11 14:57:45| helperHandleRead: 292 bytes from store_rewriter #1.
2008/07/11 14:57:45| commSetSelect: FD 6 type 1
2008/07/11 14:57:45| helperHandleRead: 'http://mysite.com?parameters&properly_modified_parameters'
2008/07/11 14:57:45| comm_select: timeout 547
2008/07/11 14:57:46| comm_select: time out
2008/07/11 14:57:46| eventRun: RUN ID 23
2008/07/11 14:57:46| eventRun: Running 'MaintainSwapSpace', id 22
2008/07/11 14:57:46| storeMaintainSwapSpace: f=0.000000, max_scan=100, max_remove=10
2008/07/11 14:57:46| cbdataFree: 019F8790
2008/07/11 14:57:46| cbdataFree: Freeing 019F8790
2008/07/11 14:57:46| storeUfsDirMaintain: c:/squid/var/cache removed 0/10 f=0.000 max_scan=100
2008/07/11 14:57:46| eventAdd: Adding 'MaintainSwapSpace', in 1.000000 seconds
2008/07/11 14:57:46| comm_select: timeout 1000
2008/07/11 14:57:47| comm_select: time out
2008/07/11 14:57:47| comm_select: timeout 1
...
<LOTS AND LOTS OF TIMEOUT lines: comm_select: timeout 1  AND comm_select: time out>
...
2008/07/11 14:57:47| eventRun: RUN ID 24
2008/07/11 14:57:47| eventRun: Running 'MaintainSwapSpace', id 23
2008/07/11 14:57:47| storeMaintainSwapSpace: f=0.000000, max_scan=100, max_remove=10
2008/07/11 14:57:47| cbdataFree: 019F8790
2008/07/11 14:57:47| cbdataFree: Freeing 019F8790
2008/07/11 14:57:47| storeUfsDirMaintain: c:/squid/var/cache removed 0/10 f=0.000 max_scan=100
2008/07/11 14:57:47| eventAdd: Adding 'MaintainSwapSpace', in 1.000000 seconds
2008/07/11 14:57:47| comm_select: timeout 1000
2008/07/11 14:57:48| comm_select: time out
2008/07/11 14:57:48| comm_select: timeout 2
...
<LOTS AND LOTS OF TIMEOUT lines: comm_select: timeout 2  AND comm_select: time out>
...
2008/07/11 14:57:48| eventRun: RUN ID 25
2008/07/11 14:57:48| eventRun: Running 'MaintainSwapSpace', id 24
2008/07/11 14:57:48| storeMaintainSwapSpace: f=0.000000, max_scan=100, max_remove=10
2008/07/11 14:57:48| cbdataFree: 019F8790
2008/07/11 14:57:48| cbdataFree: Freeing 019F8790
2008/07/11 14:57:48| storeUfsDirMaintain: c:/squid/var/cache removed 0/10 f=0.000 max_scan=100
2008/07/11 14:57:48| eventAdd: Adding 'MaintainSwapSpace', in 1.000000 seconds
2008/07/11 14:57:48| comm_select: timeout 1000
2008/07/11 14:57:49| comm_select: time out
2008/07/11 14:57:49| comm_select: timeout 1
...
<LOTS AND LOTS OF TIMEOUT lines: comm_select: timeout 1  AND comm_select: time out>
...
2008/07/11 14:57:49| eventRun: RUN ID 26
2008/07/11 14:57:49| eventRun: Running 'MaintainSwapSpace', id 25
2008/07/11 14:57:49| storeMaintainSwapSpace: f=0.000000, max_scan=100, max_remove=10
2008/07/11 14:57:49| cbdataFree: 019F8790
2008/07/11 14:57:49| cbdataFree: Freeing 019F8790
2008/07/11 14:57:49| storeUfsDirMaintain: c:/squid/var/cache removed 0/10 f=0.000 max_scan=100
2008/07/11 14:57:49| eventAdd: Adding 'MaintainSwapSpace', in 1.000000 seconds
2008/07/11 14:57:49| comm_select: timeout 1000
2008/07/11 14:57:50| comm_select: time out
2008/07/11 14:57:50| comm_select: timeout 2
...
<LOTS AND LOTS OF TIMEOUT lines: comm_select: timeout 2  AND comm_select: time out>
...
2008/07/11 14:57:50| eventRun: RUN ID 27
2008/07/11 14:57:50| eventRun: Running 'MaintainSwapSpace', id 26
2008/07/11 14:57:50| storeMaintainSwapSpace: f=0.000000, max_scan=100, max_remove=10
2008/07/11 14:57:50| cbdataFree: 019F8790
2008/07/11 14:57:50| cbdataFree: Freeing 019F8790
2008/07/11 14:57:50| storeUfsDirMaintain: c:/squid/var/cache removed 0/10 f=0.000 max_scan=100
2008/07/11 14:57:50| eventAdd: Adding 'MaintainSwapSpace', in 1.000000 seconds
2008/07/11 14:57:50| comm_select: timeout 1000
2008/07/11 14:57:50| comm_call_handlers(): got fd=32 read_event=1 write_event=0 F->read_handler=00426C0C F->write_handler=00000000
2008/07/11 14:57:50| comm_call_handlers(): Calling read handler on fd=32
2008/07/11 14:57:50| clientReadRequest: FD 32: reading request...
2008/07/11 14:57:50| clientReadRequest: FD 32 closed?
Received on Fri Jul 11 2008 - 21:18:31 MDT