RE: [squid-users] download rates w/ squid

From: Gregori Parker <[email protected]>
Date: Wed, 3 May 2006 21:28:02 -0700

Curiously, I found drastic improvement when I made the following change:

httpd_accel_with_proxy on

Obviously this requires tighter acl's for proper security.

Anyone know why this made such a huge difference???

-----Original Message-----
From: Dan Thomson [mailto:thomson.dan@gmail.com]
Sent: Wednesday, May 03, 2006 6:03 PM
To: Gregori Parker
Subject: Re: [squid-users] download rates w/ squid

I'm curious about this one as well.

Oddly enough, I seem to get a quick response until an object is
cached. Once cached, the object is transferred at a greatly reduced
speed.

My setup is pretty similar but it's on a 64 bit machine with a lot of
RAM and tonnes of hard drive space (for caching)

On 5/3/06, Gregori Parker <gregori@playstream.com> wrote:
> Once again, I'm using squid as an http-accelerator...
>
> Squid seems to be capping rate of transfer to around 80 KB/s...I'm
doing this transfer locally from one squid box to another via wget. If I
do this same transfer using scp, I get around 90 MB/s sustained. I'm
also noticing drastic fluctuations in speed when downloading from
squid...every once in awhile it will jump up to 300 KB/s, but then fall
back down to around 80 KB/s again.
>
> I have eliminated the network, hardware and server configuration as
potential problems -- I'm 99.8% sure it's squid.
>
> Does anyone have any ideas as to why squid is having trouble filling
the pipe?
>
> Here's my trimmed down conf file......
> ------------------------------------------------------
>
> http_port 80
> icp_port 0
> # no cache_peer entries
> cache_mem 256 MB
> cache_swap_low 90
> cache_swap_high 98
> maximum_object_size 256 MB
> maximum_object_size_in_memory 1024 KB
> cache_replacement_policy lru
> memory_replacement_policy lru
> cache_dir aufs /cache0/c0 40960 16 256
> cache_dir aufs /cache0/c1 40960 16 256
> # ...etc, 12 in total
> cache_access_log /usr/local/squid/var/logs/access.log
> cache_log /usr/local/squid/var/logs/cache.log
> cache_store_log none
> emulate_httpd_log on
> pid_filename /var/run/squid.pid
> debug_options ALL,1
>
> redirect_program /usr/local/squid/redir.pl
> redirect_children 20
> redirect_rewrites_host_header off
> refresh_pattern . 0 0% 4320
> half_closed_clients off
> shutdown_lifetime 4 seconds
>
> # ACCESS CONTROLS (simplified)
> acl all src 0.0.0.0/0.0.0.0
> acl origins dst xx.xxx.xxx.x/255.255.255.192
> acl acceleratedPort port 80
> http_access allow all
> http_access allow origins acceleratedPort
> http_reply_access allow all
>
> httpd_accel_port 80
> httpd_accel_host my.accelerated.hostname.com
> httpd_accel_single_host on
> httpd_accel_with_proxy off
> httpd_accel_uses_host_header off
>
> logfile_rotate 0
> log_icp_queries off
> icp_hit_stale on
> client_db off
> snmp_port 161
> acl SNMPPasswd snmp_community nottherealstring
> acl SNMPClient1 src xxx.xxx.xxx.xx/255.255.255.255
> acl SNMPClient2 src xxx.xxx.xxx.xx/255.255.255.255
> snmp_access allow SNMPClient1 SNMPPasswd
> snmp_access allow SNMPClient2 SNMPPasswd
> snmp_access deny all
> uri_whitespace allow
> strip_query_terms off
> relaxed_header_parser warn
>
>
>
Received on Wed May 03 2006 - 22:28:02 MDT

This archive was generated by hypermail pre-2.1.9 : Thu Jun 01 2006 - 12:00:01 MDT