锟斤拷: [squid-users] Large Files

HI, Adriam

We have a similar implementation as youtobe . But when we deploy squid for
large files, we found quick_abort does not work well. Problem looks like
this:

When cache miss , it is very hard for squid to get whole large file and
cache it if there are lots of multi-thread download tools, like flashget
or netransport are accessing this file at the same time. Observing through
sniffer, we found the back side connection often stopped at the point of the
first thread stopped.

->-----锟绞硷拷原锟斤拷-----
->锟斤拷锟斤拷锟斤拷: Adrian Chadd [mailto:adrian@creative.net.au]
->锟斤拷锟斤拷时锟斤拷: 2006锟斤拷9锟斤拷2锟斤拷 8:58
->锟秸硷拷锟斤拷: Mark Nottingham
->锟斤拷锟斤拷: squid-users@squid-cache.org
->锟斤拷锟斤拷: Re: [squid-users] Large Files
->
->On Fri, Sep 01, 2006, Mark Nottingham wrote:
->> I'd appreciate some enlightenment as to how Squid handles large files
->> WRT memory and disk.
->>
->> In particular;
->> - squid.conf says that memory is used for "in-transit objects."
->> What exactly is kept in memory for in-transit objects; just metadata,
->> or the whole thing?
->
->Squid used to keep the whole thing in memory. It now:
->
->* can keep the whole object in memory
->* If memory is needed, and the object is being swapped out Squid will
-> 'free' the start of the object in memory - the in-memory copy is
-> then not used to serve replies but is just there to be written to
-> disk. All subsequent hits come from disk.
->
->> - if something is in memory cache, does it get copied when it is
->> requested (because it is in-transit)?
->
->The whole object isn't copied during a memory hit; only the current
->'4k' range being read.
->
->> - How does sendfile support in 2.6 affect this?
->
->Sendfile support? :)
->
->> - Does anyone have any experiences they'd care to relate regarding
->> memory-caching very large objects?
->
->Not yet; but there's a project on my plate to evaluate this to
->begin caching p2p and youtube stuff a bit better..
->
->
->
->Adrian
->
Received on Mon Sep 04 2006 - 19:54:58 MDT