Re: [squid-users] Problem at loading advert with Squid 2.7 & 3.1

On Tue, Dec 27, 2011 at 10:37 AM, Amos Jeffries <squid3_at_treenet.co.nz> wrote:
> On Mon, 26 Dec 2011 18:21:25 +0100, feralert wrote:
>>
>> Dear all,
>>
>> Squid is not loading an advert in a web page frame which loads fine
>> when using a direct connection to the internet.
>> The versions used are 2.7.STABLE9-2.1 and 3.1.6-1.2 both in a debian
>> squezze with default configuration)
>>
>> The url the frame tries to load is:
>>
>>
>>
>> http://frame.cool.com/ad-frame/#&ad_wrap=ad-1&ad_url=http://ad.doubleclick.net/adj/site011.opus/home;Slot=Leaderboard;Pos=Top;Page=home;LoggedIn=No;tile=1;sz=728x90;&ad_timestamp=13249166700149
>>
>>
>> In squids log file I only see a line for
>> 'http://frame.cool.com/ad-frame/':
>>
>> 1324916528.019   5405 192.168.5.237 TCP_REFRESH_MISS/200 445 GET
>> http://frame.cool.com/ad-frame/ - DIRECT/67.228.247.179 text/html
>>
>> But no sight of a ''http://ad.doubleclick.net/adj/site011.opus/hom"e
>> request.
>>
>>
>> If I load the page in my computer (with a direct connection to the
>> internet) and watch http traffic with the "http fox" firefox
>> extension, I can see both requests.
>>

Hi Amos and all,

>
> The browser appears to have a bug. You demonstrated only one URL.
> "http://frame.cool.com/ad-frame/"

I forgot to mention that I tried loading the page with firefox,
chromium and IE and got the same results with all of them. And all of
them are able to load the page fine when using a direct connection to
the internet (without proxy).

>
> The '#' character is reserved for browser internal use. On a page view like
> this the browsers move the top of the visible display area down to the part
> of the page labeled
> "&ad_wrap=ad-1&ad_url=http://ad.doubleclick.net/adj/site011.opus/home;Slot=Leaderboard;Pos=Top;Page=home;LoggedIn=No;tile=1;sz=728x90;&ad_timestamp=13249166700149".
> That label is not itself a URL.
>
> So... there is no second URL to Squid, unless there is a completely separate
> lookup triggered by something else you did not mention.

Even so, I see that my first message wasn't somehow displayed properly
and might not be clear enough. Where it says 'But no sight of a ''"e
request.', I meant to say: 'But no sight of a
http://ad.doubleclick.net/adj/site011.opus/home request', meaning that
there is a GET request for the first url but not for the second (as
seen when not using squid but a direct connection to the internet).

I have taken traces of the HTTP traffic with tcpdump, which I show
below. The first one is using squid 2.7, which fails to load the ad
and the second with the direct connection to the internet, which works
flawlessly. As can be seen, when using squid, there is no data in the
reply from the server, whereas there is some in the reply to the same
request when using the direct connection, could the 'not requesting
second url' error be due to this ??

- Squid 2.7:

Host: frame.cool.com
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20100101 Firefox/10.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: es-es,es;q=0.8,en-us;q=0.5,en;q=0.3
Accept-Encoding: gzip, deflate
Proxy-Connection: keep-alive
Referer: http://www.cool.com/
Cookie: cool_all=24042dc2a0e328135316d197a53f45e8;
cool_l=%7B%22n%22%3A4%2C%22d%22%3A1%7D;
manifest=%7B%22pth%22%3A%7B%22rpge%22%3A%22home%22%7D%7D;
__qca=P0-613459998-1324917196001;
__utma=215533653.1105349504.1324917196.1324917196.1324917196.1;
__utmz=215533653.1324917196.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);
__utmv=215533653.home

HTTP/1.0 200 OK
Server: nginx/1.0.4
Content-Type: text/html; charset=UTF-8
X-Powered-By: PHP/5.3.6
Expires: Tue, 27 Dec 2011 16:22:04 GMT
Last-Modified: Mon, 26 Dec 2011 16:22:04 GMT
Cache-Control: public, max-age=86400
Date: Mon, 26 Dec 2011 16:22:04 GMT
X-Varnish: 1092645737
Age: 6176
Content-Length: 0
X-Cache: HIT from coruscant
X-Cache-Lookup: HIT from coruscant:3128
Via: 1.1 varnish, 1.1 coruscant:3128 (squid/2.7.STABLE9)
Connection: keep-alive
Proxy-Connection: keep-alive

- Direct conection to internet:

(First, the frame request)
GET /ad-frame/ HTTP/1.1
Host: frame.cool.com
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20100101 Firefox/10.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: es-es,es;q=0.8,en-us;q=0.5,en;q=0.3
Accept-Encoding: gzip, deflate
Connection: keep-alive
Referer: http://www.cool.com/
Cookie: cool_all=0395f7770045f92f9af22ee6079164ed;
cool_l=%7B%22c%22%3A%22ES%22%2C%22n%22%3A1%2C%22d%22%3A1%7D;
manifest=%7B%22pth%22%3A%7B%22rpge%22%3A%22home%22%7D%7D;
__qca=P0-698414843-1324923294457

HTTP/1.1 200 OK
Server: nginx/1.0.4
Content-Type: text/html; charset=UTF-8
Keep-Alive: timeout=10
X-Powered-By: PHP/5.3.6
Expires: Tue, 27 Dec 2011 18:14:55 GMT
Last-Modified: Mon, 26 Dec 2011 18:14:55 GMT
Cache-Control: public, max-age=86400
Content-Encoding: gzip
Content-Length: 784
Date: Mon, 26 Dec 2011 18:14:55 GMT
X-Varnish: 1092718183
Age: 0
Via: 1.1 varnish
Connection: keep-alive

^_<8B>^H^@^@^@^@^@^@^C<85>Umo<D3>0^P<FE><9E>_q2hIYצc^C<B6>%E^ZL<BC>HC<88><8D>OmA^|M<8C><92>88N_@<FD><EF><9C><F3>R:X!^_R<F7><FC><DC>swϝ<9D>
1Y:v<82>^D<B9>^X
<83>^Sdh8$<C6>^TG<U+F522D0>E<J<F0>(R<B9><D1>*e`^W<98><9B><90>^U<D5>]*<A3>>d|u<C4>c^L_<;<F1>}FL^?1ઐ^Z<CB>^]<DF><DB>
<FB>p<FC>^\^c^D<C7><FE>h^D<A3>^W磓<F3><D3>Sxs}<FB>
G<CA>Ks<94>)!<E7>^R<C5>^Nӵʉ<E9><D9>~

(Secondly, the ad request)

GET /adj/site011.opus/home;Slot=Leaderboard;Pos=Top;Page=home;LoggedIn=No;tile=1;sz=728x90;ord=13249232923304;
HTTP/1.1
Host: ad.doubleclick.net
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20100101 Firefox/10.0
Accept: */*
Accept-Language: es-es,es;q=0.8,en-us;q=0.5,en;q=0.3
Accept-Encoding: gzip, deflate
Connection: keep-alive
Referer: http://frame.snooth.com/ad-frame/

HTTP/1.1 200 OK
Server: DCLK-AdSvr
Content-Type: application/x-javascript
Content-Length: 352
Set-Cookie: test_cookie=CheckForPermission; path=/;
domain=.doubleclick.net; expires=Mon, 26 Dec 2011 18:29:56 GMT
P3P: CP="CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM
NAV OTC NOI DSP COR"
Content-Encoding: gzip
Date: Mon, 26 Dec 2011 18:14:56 GMT
Expires: Mon, 26 Dec 2011 18:14:56 GMT
Cache-Control: private

^_<8B>^H^@^@^@^@^@^@^K]Q<D1>j<DD>0^L}<DF>Wx<81>KׇESC۲<9D><D8>u<D3>Q
{<DA>?^D'Vnқ<C4><C5>q<9A><B7>~<FB><DC>K^YlH<A0>#<D0><E1>HG><F4><FB><82>k*<8F>8%<FC>q<F7><E8>Hr<F1><82><A9>)<DA>nv<EB><B5>
cġ)Ɣ<DE>^^(u<BE><F4>a<EF>f<EC>穿
<96>+&zCvl<DE>5^U^]^Z<CA>r<9C><C0><D1>W^K<92>seT<C5>,<9C><99>e<B6>^R<C6

Apologies for the long message and many thanks for the replies.

Cheers,
Fred
Received on Tue Dec 27 2011 - 10:21:49 MST