[squid-users] Problem with HTTP Headers

From: Ghassan Gharabli <sounarose_at_googlemail.com>
Date: Fri, 11 Nov 2011 23:30:15 +0200

Hello,

I am facing a trouble with Caching HTTP Headers.

Everyday I see that www.facebook.com header is being cached and then I
try to remove it manually from Cache and so other websites ...

I tried to add these refresh_patterns before any rule but
unfortunately with no luck!

refresh_pattern -i \.(htm|html|jhtml|mhtml|php)(\?.*|$) 0 0% 0
refresh_pattern ^http:\/\/www\.facebook\.com$ 0 0% 0

REFRESH_PATTERN CONFIG :
------------------------------------------------
# 1 year = 525600 mins, 1 month = 43800 mins
refresh_pattern
(get_video|videoplayback|videodownload|\.flv).*(begin|start)\=[1-9][0-9]* 0
0% 0
refresh_pattern -i \.(htm|html|jhtml|mhtml|php)(\?.*|$) 0 0% 0
refresh_pattern ^http:\/\/www\.facebook\.com$ 0 0% 0
refresh_pattern ^http:\/\/www.filefactory.com.*\.(mp3) 0 0% 0
refresh_pattern imeem.*\.flv 0 0% 0 override-lastmod override-expire
refresh_pattern ^ftp: 40320 20% 40320 override-expire reload-into-ims
refresh_pattern ^gopher: 1440 0% 1440

#youtube's videos
refresh_pattern
(get_video\?|videoplayback\?|generate_204\?|videodownload\?|\.flv\?|\.fid\?)
5259487 99999999% 5259487 override-expire ignore-reload store-stale
ignore-private negative-ttl=0

#YouTube's Embeded Videos
refresh_pattern ^http:\/\/www\.youtube\.com\/v\/.* 5259487 99999999%
5259487 override-expire ignore-reload store-stale ignore-private
negative-ttl=0

#VideoZer
refresh_pattern (video\?) 5259487 99999999% 5259487 override-expire
ignore-reload store-stale ignore-private ignore-no-store
ignore-must-revalidate ignore-no-cache

#ads
refresh_pattern
^.*(streamate.doublepimp.com.*\.js\?|utm\.gif|ads\?|rmxads\.com|ad\.z5x\.net|bh\.contextweb\.com|bstats\.adbrite\.com|a1\.interclick\.com|ad\.trafficmp\.com|ads\.cubics\.com|ad\.xtendmedia\.com).*
         5259487 20% 5259487 ignore-no-cache ignore-no-store
ignore-private override-expire ignore-reload ignore-auth
ignore-must-revalidate store-stale negative-ttl=40320 max-stale=1440
refresh_pattern
^.*(\.googlesyndication\.com|advertising\.com|yieldmanager|game-advertising\.com|pixel\.quantserve\.com|adperium\.com|doubleclick\.net|adserving\.cpxinteractive\.com|syndication\.com|media.fastclick.net).*
5259487 20% 5259487 ignore-no-cache ignore-no-store ignore-private
override-expire ignore-reload ignore-auth ignore-must-revalidate
store-stale negative-ttl=40320 max-stale=1440

#Rapidshare
refresh_pattern \.rapidshare.*\/[0-9]*\/.*\/[^\/]* 161280 90% 161280
ignore-no-cache ignore-reload override-expire store-stale

#Uploaded.to
refresh_pattern ^http:\/\/[.a-z0-9-]*\.uploaded\.to.* 161280 90%
161280 ignore-no-cache override-expire ignore-reload
ignore-stale-while-revalidate store-stale

#FileSonic
refresh_pattern ^http:\/\/s[0-9]+\.filesonic\.com\/download\/.*
259487 999999% 259487 ignore-no-cache ignore-no-store reload-into-ims
override-expire ignore-must-revalidate ignore-private store-stale

#WLM MsgrConfig
refresh_pattern
^http:\/\/config\.messenger\.msn\.com\/Config\/MsgrConfig\.asmx\?.*
  5259487 999999% 5259487 ignore-private ignore-no-cache
override-expire ignore-reload ignore-must-revalidate ignore-no-store
reload-into-ims store-stale

#reverbnation.com
refresh_pattern
^http:\/\/[a-z0-9]*\.reverbnation\.com\/audio_player\/stream_song\/(.*)
 5259487 999999% 5259487 ignore-no-cache override-expire ignore-reload
ignore-stale-while-revalidate ignore-must-revalidate ignore-no-store
reload-into-ims store-stale

#Fileserve.com
refresh_pattern fileserve\.com.*\.(mp3|rar|zip|vob|mpg) 5259487
999999% 5259487 ignore-no-cache override-expire ignore-reload
ignore-stale-while-revalidate store-stale ignore-no-store
ignore-must-revalidate

# Icons + Video Stats
refresh_pattern \.(ico|video-stats) 5259487 999999% 5259487
override-expire ignore-reload ignore-no-cache ignore-no-store
ignore-private ignore-auth override-lastmod ignore-must-revalidate
negative-ttl=10080 store-stale
refresh_pattern \.etology\? 5259487 999999% 5259487 override-expire
ignore-reload ignore-no-cache store-stale
refresh_pattern galleries\.video(\?|sz) 5259487 999999%
5259487 override-expire ignore-reload ignore-no-cache store-stale

#Brazzers
refresh_pattern brazzers\? 5259487 999999% 5259487 override-expire
ignore-reload ignore-no-cache store-stale
refresh_pattern \.adtology\? 5259487 999999% 5259487 override-expire
ignore-reload ignore-no-cache store-stale

# Google / Google Safe Browsing
refresh_pattern ^.*safebrowsing.*google
                 5259487 999999% 5259487 override-expire ignore-reload
ignore-no-cache ignore-no-store ignore-private ignore-auth
ignore-must-revalidate negative-ttl=10080 store-stale
refresh_pattern ^http://((cbk|mt|khm|mlt)[0-9]?)\.google\.co(m|\.uk)
               5259487 999999% 5259487 override-expire ignore-reload
store-stale ignore-private negative-ttl=10080
refresh_pattern
^http://((cbk|mt|khm|mlt)[0-9]?)\.googleapis\.co(m|\.uk)
5259487 999999% 5259487 override-expire ignore-reload store-stale
ignore-private negative-ttl=10080
refresh_pattern
^http://((cbk|mt|khm|mlt)[0-9]?)\.google\.com(\.lb|\.sa|\.qa|\.om|\.ar|\.ly|\.au|\.eg)
        5259487 999999% 129600 override-expire ignore-reload store-stale
ignore-private negative-ttl=10080
refresh_pattern
^http://((cbk|mt|khm|mlt)[0-9]?)\.google\.(de|fr|ae|jo|ie|it) 5259487
99999% 5259487 override-expire ignore-reload store-stale
ignore-private negative-ttl=10080
refresh_pattern ^http://kh\.google\.com.*\/flatfile\?.*
        5259487 99999% 5259487 override-expire ignore-reload store-stale
ignore-private negative-ttl=10080

# YouTube Pictures
refresh_pattern ytimg\.com.*\.(jpg|png|gif|swf) 5259487 999999%
5259487 override-expire ignore-reload store-stale

refresh_pattern images\.friendster\.com.*\.(png|gif) 5259487 999999%
5259487 override-expire ignore-reload store-stale

refresh_pattern garena\.com 5259487 999999% 5259487 override-expire
reload-into-ims store-stale
refresh_pattern
photobucket.*\.(jp(e?g|e|2)|tiff?|bmp|gif|png|css|js|xml) 5259487
999999% 5259487 override-expire ignore-reload store-stale

# DailyMotion Content
refresh_pattern vid\.akm\.dailymotion\.com.*\.on2\?
  5259487 999999% 5259487 ignore-no-cache override-expire
override-lastmod store-stale
refresh_pattern .fbcdn.net.*\.(jpg|gif|png) 5259487 999999%
5259487 ignore-no-cache override-expire ignore-reload store-stale
negative-ttl=0
refresh_pattern ^http:\/\/images|pics|thumbs[0-9]\.
  5259487 999999% 5259487 ignore-no-cache ignore-no-store
ignore-reload override-expire store-stale
refresh_pattern ^http:\/\/www.onemanga.com.*\/
  5259487 999999% 5259487 reload-into-ims override-expire store-stale

# MediaFire Images
refresh_pattern
mediafire.com\/images.*\.(jp(e?g|e|2)|tiff?|bmp|gif|png) 5259487
999999% 5259487 reload-into-ims override-expire ignore-private
store-stale

# ANTI VIRUS (AVG|AVIRA|Symantec|Kaspersky|mbam|nai)
refresh_pattern guru.avg.com/.*\.(bin) 43200 999999% 43200
ignore-no-cache ignore-no-store ignore-reload reload-into-ims
store-stale
refresh_pattern (avgate|avira).*(idx|gz)$
43200 999999% 43200 ignore-no-cache ignore-no-store ignore-reload
reload-into-ims store-stale
refresh_pattern update.nai.com/.*\.(gem|zip|mcs)
43200 999999% 43200 ignore-no-cache ignore-no-store ignore-reload
reload-into-ims store-stale
refresh_pattern symantecliveupdate.com.*\(zip|exe)
  43200 999999% 43200 ignore-no-cache ignore-no-store ignore-reload
reload-into-ims store-stale
refresh_pattern kaspersky.*\.avc$
  129600 999999% 129600 ignore-reload store-stale
refresh_pattern kaspersky
  1440 50% 161280 ignore-no-cache store-stale
refresh_pattern mbamupdates.com.*\.ref 1440 90% 161280
reload-into-ims store-stale

# Microsoft Windows Updates/Downloads
refresh_pattern
((au\.download\.)?windowsupdate\.com|(download|update).microsoft.com)/.*\.(cab|exe|dll|psf)
5259487 999999% 5259487 ignore-no-cache ignore-no-store ignore-reload
reload-into-ims store-stale

#banner IIX
refresh_pattern
^http:\/\/openx.*\.(jp(e?g|e|2)|gif|pn[pg]|swf|ico|css|tiff?) 129600
999999% 129600 reload-into-ims ignore-reload override-expire
ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/ads(1|2|3).kompas.com.*\/
        43200 999999% 129600 reload-into-ims ignore-reload
override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/img.ads.kompas.com.*\/
        43200 999999% 129600 reload-into-ims ignore-reload
override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern .kompasimages.com.*\.(jpg|gif|png|swf)
        43200 999999% 129600 reload-into-ims ignore-reload
override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/openx.kompas.com.*\/
        43200 999999% 129600 reload-into-ims ignore-reload
override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern kaskus.\us.*\.(jp(e?g|e|2)|gif|png|swf)
        43200 999999% 129600 reload-into-ims ignore-reload
override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/img.kaskus.us.*\.(jpg|gif|png|swf)
        43200 999999% 129600 reload-into-ims ignore-reload
override-expire ignore-no-cache ignore-no-store store-stale

#IIX DOWNLOAD
refresh_pattern
^http:\/\/\.www[0-9][0-9]\.indowebster\.com\/(.*)(mp3|rar|flv|wmv|3gp|m­p(4|3)|exe|msi|zip)
43200 99999% 129600 reload-into-ims ignore-reload override-expire
ignore-no-cache ignore-no-store store-stale ignore-auth

# Facebook Games
refresh_pattern ^http:\/\/apps.facebook.com.*\/ 10080 999999% 43200
ignore-reload override-expire ignore-no-cache ignore-no-store
store-stale
refresh_pattern -i \.zynga.com.*\/ 10080 999999% 43200
ignore-reload override-expire ignore-no-cache ignore-no-store
ignore-must-revalidate store-stale
refresh_pattern -i \.farmville.com.*\/ 10080 999999% 43200
ignore-reload override-expire ignore-no-cache ignore-no-store
ignore-must-revalidate store-stale
refresh_pattern -i \.ninjasaga.com.*\/ 10080 999999% 43200
ignore-reload override-expire ignore-no-cache ignore-no-store
ignore-must-revalidate store-stale
refresh_pattern -i \.mafiawars.com.*\/ 10080 999999% 43200
ignore-reload override-expire ignore-no-cache ignore-no-store
ignore-must-revalidate store-stale
refresh_pattern -i \.crowdstar.com.*\/ 10080 999999% 43200
ignore-reload override-expire ignore-no-cache ignore-no-store
ignore-must-revalidate store-stale
refresh_pattern -i \.popcap.com.*\/ 10080 999999% 43200
ignore-reload override-expire ignore-no-cache ignore-no-store
ignore-must-revalidate store-stale

# Google Search Images
refresh_pattern (gstatic|diggstatic)\.com/.*
  43200 9999% 43200 override-expire ignore-reload ignore-no-cache
ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern ^http:\/\/\.*\.gstatic\.com\/(.*) 129600 999999%
129600 reload-into-ims ignore-no-cache ignore-no-store ignore-reload
override-expire store-stale

# Other Extensions
refresh_pattern \.(class|css|cssz|js|jsz|xml|jhtml|txt|tif)
                                   129600 999999% 129600
ignore-no-cache ignore-no-store override-lastmod reload-into-ims
override-expire ignore-must-revalidate store-stale ignore-private
refresh_pattern \.(doc|xls|ppt|ods|odt|odp|pdf|rtf|inf|ini)
                                   129600 999999% 129600
ignore-no-cache ignore-no-store override-lastmod reload-into-ims
override-expire ignore-must-revalidate store-stale ignore-private
refresh_pattern \.(jp(e?g|e|2)|tiff?|bmp|gif|png|kmz)
                                   129600 999999% 129600
ignore-no-cache ignore-no-store override-lastmod reload-into-ims
override-expire ignore-must-revalidate store-stale ignore-private
refresh_pattern
\.(z(ip|[0-9]{2})|r(ar|[0-9]{2})|jar|tgz|bz2|grf|gpf|lz|lzh|lha|arj|gz|ipa|tar|rpm|vpu)
  129600 999999% 129600 ignore-no-cache ignore-no-store
override-lastmod reload-into-ims override-expire
ignore-must-revalidate store-stale ignore-private
refresh_pattern
\.(mp(2|3|4)|wav|og(g|a)|flac|mid|midi?|rm|aac|mka|ape)
            129600 999999% 129600 ignore-no-cache ignore-no-store
override-lastmod reload-into-ims override-expire
ignore-must-revalidate store-stale ignore-private
refresh_pattern
\.(exe|msi|dmg|bin|xpi|fid|iso|part|mar|psf|msp|cab|npk|inc|hqx|ad)
                   129600 999999% 129600 ignore-no-cache
ignore-no-store override-lastmod reload-into-ims override-expire
ignore-must-revalidate store-stale ignore-private
refresh_pattern
\.(mpeg|ra?m|avi|mp(g|e|4)|mov|m4v|qt|divx|asf|wm(a|v)|m\dv|rv|vob|asx|ogm|flv|3gp|on2|swf)
129600 999999% 129600 ignore-no-cache ignore-no-store reload-into-ims
override-expire ignore-must-revalidate store-stale ignore-private
ignore-reload
refresh_pattern -i (cgi-bin) 0 0% 0
refresh_pattern \.(php|jsp|cgi|asx)\? 0 0% 0
refresh_pattern . 0 0% 0

----------------------------------------------------------------
TUNING CONFIG
-------------------------

header_access X-Forwarded-For deny all
header_replace Accept-Language en

cache_replacement_policy heap LFUDA

shutdown_lifetime 8 seconds
cache_swap_low 97
cache_swap_high 98
minimum_object_size 0 KB
maximum_object_size 5 GB
maximum_object_size_in_memory 128 KB
cache_mem 256 MB
uri_whitespace strip
cache_vary on
via off
forwarded_for off
vary_ignore_expire on
httpd_suppress_version_string on
memory_pools off
reload_into_ims on
maximum_single_addr_tries 2
retry_on_error on
max_stale 10 years
quick_abort_min -1 KB
negative_dns_ttl 1 second
negative_ttl 1 second
range_offset_limit -1
offline_mode off
ipcache_size 4096
fqdncache_size 4096
strip_query_terms off
pipeline_prefetch on
client_persistent_connections off
server_persistent_connections off

Could you please tell me where is the problem ?
Received on Fri Nov 11 2011 - 21:30:22 MST

This archive was generated by hypermail 2.2.0 : Sat Nov 12 2011 - 12:00:02 MST