Re: [squid-users] mime-type based delay pools

I am using simple file extension based delay pools. This is what the
config looks like:

acl big-files url_regex -i .flv .avi .wmv .mpg .mpeg .mpe .divx .mov
.qt .mp3 .wav .ram .rm .rar .zip .gz .bz2 .iso .exe .rpm .deb .raw
delay_pools 2
delay_class 1 3
delay_access 1 Allow big-files lan
delay_access 1 Deny all
delay_parameters 1 524288/524288 -1/-1 16384/4194304
delay_class 2 1
delay_access 2 Allow lan
delay_access 2 Deny big-files
delay_access 2 Deny all
delay_parameters 2 -1/-1

The "downloads" delay pool is rarely, if ever, less than 90% utilized,
according to squidclient (the "current" reading). That would mean ~4
Mbps + normal browsing bandwidth. But the server in traffic, at the
same time, is ~120 kBps. Shouldn't it be much higher?

On Jan 21, 2008 12:11 PM, Adrian Chadd <adrian@creative.net.au> wrote:
> On Mon, Jan 21, 2008, Amitava Bhattacharyya wrote:
> > I followed this discussion: "[squid-users] Re: Re: Cache Streaming
> > Video?" (http://www.squid-cache.org/mail-archive/squid-users/200701/0154.html).
> > Seems that making the maximum_object_size higher has an effect, so I
> > have set it to 50 MB. Calamaris says youtube.com is getting a hit of
> > 40%.
> > But the problem is not just youtube. People do download 100 MB+ files.
> > I want to test whether separating text/* mimetypes from the others and
> > putting the other mimetypes on a separate, bandwidth limited stream
> > would help.
>
> I thought squid-3 had some "class 4 delay pool" stuff to make this a possibility
> right now.
>
> You can fake it though, with tcp_outgoing_tos based ACLs. You set the TOS
> (or select another IP!) for certain mime types, and then rate limit that
> IP address.
>
> (I've done the latter quite successfully. ;)
>
>
>
> Adrian
>
>
> >
> > On Jan 20, 2008 9:44 PM, Adrian Chadd <adrian@creative.net.au> wrote:
> > > The first thing I'd do before looking at delay pools is to grab
> > > a few days of logfiles, pass them through calamaris or something
> > > similar and generate some traffic reports.
> > >
> > > If youtube is a big bandwidth hog then you may benefit from some
> > > of my work to make Squid cache youtube.
> > >
> > >
> > >
> > >
> > > Adrian
> > >
> > >
> > > On Sun, Jan 20, 2008, Amitava Bhattacharyya wrote:
> > > > Hi!
> > > >
> > > > I am a member of the Student Network Club at our institute. We are
> > > > facing problems related to slow access speeds, even though the
> > > > bandwidth is not so less (12 Mbps for students). We decided to set up
> > > > our own proxy server (since getting authorization to access/modify the
> > > > institute servers would take quite some time) to monitor utilization.
> > > > As part of this exercise, we would also like to implement delay pool
> > > > based bandwidth management. Since it is very likely that big downloads
> > > > and youtube are eating up the bandwidth, will a mime type based delay
> > > > pool work in this case? And how exactly do I set it up?
> > > > For example, if i define two delay pools, one based on based on hostel
> > > > IPs and the other on mime-types (question: would this be a class 1
> > > > delay pool?), and say give limit of 16 kBps / 4 MB for the downloads
> > > > stream, how will this be enforced? Will this mean that _every_
> > > > download less than 4 MB goes un-delayed, and beyond that it fills up
> > > > at 16 kBps?
> > > >
> > > > --
> > > > Best regards,
> > > >
> > > > Amitava Bhattacharyya
> > > > PGP Class of 2008, Indian Institute of Management Bangalore
> > > > J-310, Hostel Blocks, IIM Bangalore
> > > > Bangalore, Karnataka 560076 INDIA
> > > > +919986695721
> > >
> > > --
> > > - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
> > > - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > Amitava Bhattacharyya
> > PGP Class of 2008, Indian Institute of Management Bangalore
> > J-310, Hostel Blocks, IIM Bangalore
> > Bangalore, Karnataka 560076 INDIA
> > +919986695721
>
> --
>
> - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
> - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
>

-- 
Best regards,
Amitava Bhattacharyya
PGP Class of 2008, Indian Institute of Management Bangalore
J-310, Hostel Blocks, IIM Bangalore
Bangalore, Karnataka 560076 INDIA
+919986695721