[squid-users] Squid 2.5 and Range requests

From: osuser os <[email protected]>
Date: Sun, 25 Apr 2004 00:25:55 -0700

Hi,
I am seeing a strange behavior of Squid 2.5 proxy on windows when Range
requests are used to download files.
I am using the default squid configuration and hence the range_offset_limit
is 0
I see that when a Range request starting with 0 is sent, squid is retrieving
the whole file from the server and then sends the requested range to the
client. The file is cached and hence future range requests are served from
cache.
But if the file size > 20 KB, I see that the full file is still being
retrieved, but is not being put in the cache. (future requests starting with
range 0 are resulting in full file being retrieved again and not put in the
cache). That means that server bandwidth consumed is a lot more than client
bandwidth especially for large files.
Is this a known issue with squid or some configuration error on my part?
Any help in troubleshooting this problem would be appreciated.

Thanks
Marc

Following logs show the response from squid server for 2 requests for each
of 2 URLs (one of size = 20K, the other about 21K). For the 1st URL, the 2nd
request is served from the cache whereas for the 2nd URL, the 2nd request is
again a MISS. The same behavior is seen for other URLs > 20K
I have shown the access.log and store.log also below

REQUEST: **************\nGET http://XXXX:80/dload/19k.zip HTTP/1.1\r\n
range: bytes=0-10\r\n
Host: XXXX\r\n
Accept: */*\r\n
\r\n
RESPONSE: **************\nHTTP/1.0 206 Partial Content\r\n
Content-Type: application/x-zip-compressed\r\n
Last-Modified: Wed, 21 Apr 2004 00:18:18 GMT\r\n
Accept-Ranges: bytes\r\n
Server: Microsoft-IIS/6.0\r\n
Date: Sun, 25 Apr 2004 06:48:41 GMT\r\n
Content-Range: bytes 0-10/20480\r\n
Content-Length: 11\r\n
X-Cache: MISS from XXXX\r\n
Proxy-Connection: close\r\n
\r\n
a,������������������\x012������\x019,������������

REQUEST: **************\nGET http://XXXX:80/dload/19k.zip HTTP/1.1\r\n
range: bytes=0-10\r\n
Host: XXXX\r\n
Accept: */*\r\n
\r\n
RESPONSE: **************\nHTTP/1.0 206 Partial Content\r\n
Content-Type: application/x-zip-compressed\r\n
Last-Modified: Wed, 21 Apr 2004 00:18:18 GMT\r\n
Accept-Ranges: bytes\r\n
Server: Microsoft-IIS/6.0\r\n
Date: Sun, 25 Apr 2004 06:48:41 GMT\r\n
Content-Range: bytes 0-10/20480\r\n
Content-Length: 11\r\n
Age: 35\r\n
X-Cache: HIT from XXXX\r\n
Proxy-Connection: close\r\n
\r\n
a,������������������\x012������\x019,������������

REQUEST: **************\nGET http://XXXX:80/dload/20k.zip HTTP/1.1\r\n
range: bytes=0-10\r\n
Host: XXXX\r\n
Accept: */*\r\n
\r\n
RESPONSE: **************\nHTTP/1.0 206 Partial Content\r\n
Content-Type: application/x-zip-compressed\r\n
Last-Modified: Sat, 02 Aug 2003 00:14:56 GMT\r\n
Accept-Ranges: bytes\r\n
Server: Microsoft-IIS/6.0\r\n
Date: Sun, 25 Apr 2004 06:51:13 GMT\r\n
Content-Range: bytes 0-10/21504\r\n
Content-Length: 11\r\n
X-Cache: MISS from XXXX\r\n
Proxy-Connection: close\r\n
\r\n
a,������������������\x012������\x019,������������

REQUEST: **************\nGET http://XXXX:80/dload/20k.zip HTTP/1.1\r\n
range: bytes=0-10\r\n
Host: XXXX\r\n
Accept: */*\r\n
\r\n
RESPONSE: **************\nHTTP/1.0 206 Partial Content\r\n
Content-Type: application/x-zip-compressed\r\n
Last-Modified: Sat, 02 Aug 2003 00:14:56 GMT\r\n
Accept-Ranges: bytes\r\n
Server: Microsoft-IIS/6.0\r\n
Date: Sun, 25 Apr 2004 06:51:15 GMT\r\n
Content-Range: bytes 0-10/21504\r\n
Content-Length: 11\r\n
X-Cache: MISS from XXXX\r\n
Proxy-Connection: close\r\n
\r\n
a,������������������\x012������\x019,������������
finished.

access.log
----------
1082875737.425 30 CLIENT_IP TCP_MISS/200 353 GET
http://XXXX/dload/19k.zip - DIRECT/XXXX application/x-zip-compressed
1082875756.824 0 CLIENT_IP TCP_HIT/200 361 GET
http://XXXX/dload/19k.zip - NONE/- application/x-zip-compressed
1082875889.772 50 CLIENT_IP TCP_MISS/200 353 GET
http://XXXX/dload/20k.zip - DIRECT/XXXX application/x-zip-compressed
1082875891.635 11 CLIENT_IP TCP_MISS/200 353 GET
http://XXXX/dload/20k.zip - DIRECT/XXXX application/x-zip-compressed

store.log
---------
1082875737.425 SWAPOUT 00 00000000 38A941021AF0394EC142960D10274A1C 200
1082875721 1082506698 -1 application/x-zip-compressed 20480/20480 GET
http://XXXX/dload/19k.zip
1082875889.772 RELEASE 00 00000004 A24A5C5085AA217D94069DB37262A075 200
1082875873 1059783296 -1 application/x-zip-compressed 21504/4108 GET
http://XXXX/dload/20k.zip
1082875891.635 RELEASE -1 FFFFFFFF CAC0B4B4747B833A461F5CDDE0E866F8 200
1082875875 1059783296 -1 application/x-zip-compressed 21504/2648 GET
http://XXXX/dload/20k.zip

_________________________________________________________________
FREE pop-up blocking with the new MSN Toolbar � get it now!
http://toolbar.msn.com/go/onm00200415ave/direct/01/
Received on Sun Apr 25 2004 - 01:25:56 MDT

This archive was generated by hypermail pre-2.1.9 : Fri Apr 30 2004 - 12:00:02 MDT