[squid-users] SQUID makes few slow connections (see video) from Tytus Rogalewski on 2010-06-01 (squid-users)

From: Tytus Rogalewski <tytanick_at_gmail.com>
Date: Tue, 1 Jun 2010 23:50:35 +0200

I thik that this is something to do it with many requests, because
half of images are loaded imiedietly (with hits MISS) , and rest are
loaded after few seconds (also MISSED) - missed because i have erased
cache. and is page is cached - it works fine. Only NEW requests are
working slowly
(Read below full problem)
here is more info:
--------------------------
sky-link squid # squidclient -h 192.168.0.1 -p 8123 mgr:info
HTTP/1.0 200 OK
Server: squid/3.0.STABLE20
Mime-Version: 1.0
Date: Tue, 01 Jun 2010 21:47:50 GMT
Content-Type: text/plain
Expires: Tue, 01 Jun 2010 21:47:50 GMT
Last-Modified: Tue, 01 Jun 2010 21:47:50 GMT
X-Cache: MISS from sky-link.net
X-Cache-Lookup: MISS from sky-link.net:8123
Via: 1.0 sky-link.net (squid/3.0.STABLE20)
Proxy-Connection: close

Squid Object Cache: Version 3.0.STABLE20
Start Time: Tue, 01 Jun 2010 21:47:46 GMT
Current Time: Tue, 01 Jun 2010 21:47:50 GMT
Connection information for squid:
        Number of clients accessing cache: 1
        Number of HTTP requests received: 0
        Number of ICP messages received: 0
        Number of ICP messages sent: 0
        Number of queued ICP replies: 0
        Number of HTCP messages received: 0
        Number of HTCP messages sent: 0
        Request failure ratio: 0.00
        Average HTTP requests per minute since start: 0.0
        Average ICP messages per minute since start: 0.0
        Select loop called: 2945 times, 1.105 ms avg
Cache information for squid:
        Hits as % of all requests: 5min: 0.0%, 60min: 0.0%
        Hits as % of bytes sent: 5min: -0.0%, 60min: -0.0%
        Memory hits as % of hit requests: 5min: 0.0%, 60min: 0.0%
        Disk hits as % of hit requests: 5min: 0.0%, 60min: 0.0%
        Storage Swap size: 12692 KB
        Storage Swap capacity: 0.0% used, 100.0% free
        Storage Mem size: 108 KB
        Storage Mem capacity: 0.0% used, 100.0% free
        Mean Object Size: 6.36 KB
        Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
        HTTP Requests (All): 0.00000 0.00000
        Cache Misses: 0.00000 0.00000
        Cache Hits: 0.00000 0.00000
        Near Hits: 0.00000 0.00000
        Not-Modified Replies: 0.00000 0.00000
        DNS Lookups: 0.00000 0.00000
        ICP Queries: 0.00000 0.00000
Resource usage for squid:
        UP Time: 3.255 seconds
        CPU Time: 0.040 seconds
        CPU Usage: 1.23%
        CPU Usage, 5 minute avg: 0.00%
        CPU Usage, 60 minute avg: 0.00%
        Process Data Segment Size via sbrk(): 4244 KB
        Maximum Resident Size: 54512 KB
        Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
        Total space in arena: 4520 KB
        Ordinary blocks: 4514 KB 2 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 5916 KB 10 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 5 KB
        Total in use: 10430 KB 100%
        Total free: 5 KB 0%
        Total size: 10436 KB
Memory accounted for:
        Total accounted: 1969 KB 19%
        memPool accounted: 1969 KB 19%
        memPool unaccounted: 8466 KB 81%
        memPoolAlloc calls: 9684
        memPoolFree calls: 4422
File descriptor usage for squid:
        Maximum number of file descriptors: 1024
        Largest file desc currently in use: 15
        Number of file desc currently in use: 9
        Files queued for open: 0
        Available number of file descriptors: 1015
        Reserved number of file descriptors: 100
        Store Disk files open: 0
Internal Data Structures:
          2024 StoreEntries
            27 StoreEntries with MemObjects
            26 Hot Object Cache Items
          1997 on-disk objects
---------------------------

2010/6/1 Tytus Rogalewski <tytanick_at_gmail.com>:
> Hi guys, i have problem with slow performance in my squid
> When i enter the page WITHOUT squid, pages are loaded in ~1 sec,
> but when i turn on SQUID - page load in 70% in 1 sec, and then few
> images are loading very slowly
>
> I made flash movie - you can see how this slow connevting VIA squid works
> http://sky-link.net/temp/squid/squid_performance.html (10 MB - i have
> slow connection so you need to wait few mins :)
>
> ----------------------------
> Server Hardware:
> Core2Duo E4600 3.0 Ghz
> 4 GB ramu
> Dysk Szajsung 640GB (w fstabie dopisany noatime 0 0)
>
> Server Soft:
> Linux Gentoo
> squid-3.0.19 or 3.0.20 is the same thing
>
>
> ============================
> Squid, access.log
> You can see in second collumn when did image loaded fully. (1000 = 1 sec)
> Look at 3 last rows, 3 sec,m 6 sec ened even 12 sec ? wtf ?
>
> 1275413778.282 ï¿½ ï¿½401 192.168.0.2 TCP_MISS/200 20538 GET
> http://allegro.pl/76700_dodatki_i_ozdoby.html? - DIRECT/193.23.48.134
> text/html
> 1275413778.417 ï¿½ ï¿½ 41 192.168.0.2 TCP_MISS/200 2845 GET
> http://img16.allegroimg.pl/photos/64x48/10/52/33/52/1052335222 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.426 ï¿½ ï¿½ 48 192.168.0.2 TCP_MISS/200 1955 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748223 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.436 ï¿½ ï¿½ 53 192.168.0.2 TCP_MISS/200 2124 GET
> http://img14.allegroimg.pl/photos/64x48/10/47/88/44/1047884413 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.447 ï¿½ ï¿½ 61 192.168.0.2 TCP_MISS/200 2564 GET
> http://img04.allegroimg.pl/photos/64x48/10/60/13/27/1060132706 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.461 ï¿½ ï¿½ 70 192.168.0.2 TCP_MISS/200 1880 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/44/1048294443 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.473 ï¿½ ï¿½ 82 192.168.0.2 TCP_MISS/200 1811 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/45/1048294559 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.487 ï¿½ ï¿½ 95 192.168.0.2 TCP_MISS/200 1906 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/46/1048294688 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.503 ï¿½ ï¿½ 73 192.168.0.2 TCP_MISS/200 2226 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749248 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.511 ï¿½ ï¿½124 192.168.0.2 TCP_MISS/200 2012 GET
> http://img11.allegroimg.pl/photos/64x48/10/48/20/58/1048205827 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.526 ï¿½ ï¿½137 192.168.0.2 TCP_MISS/200 2475 GET
> http://img11.allegroimg.pl/photos/64x48/10/48/21/13/1048211380 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.541 ï¿½ ï¿½ ï¿½0 192.168.0.2 TCP_DENIED/403 353 GET
> http://allegro.hit.gemius.pl/_1275413783164/rexdot.gif? - NONE/-
> text/html
> 1275413778.549 ï¿½ ï¿½ 41 192.168.0.2 TCP_MISS/200 2422 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749229 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.600 ï¿½ ï¿½ 47 192.168.0.2 TCP_MISS/200 480 GET
> http://www.google-analytics.com/__utm.gif? - DIRECT/209.85.129.101
> image/gif
> 1275413778.615 ï¿½ ï¿½ 55 192.168.0.2 TCP_MISS/200 2692 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/40/1048114081 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.659 ï¿½ ï¿½ 42 192.168.0.2 TCP_MISS/200 2754 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/40/1048114095 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.669 ï¿½ ï¿½289 192.168.0.2 TCP_MISS/200 2488 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749270 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.678 ï¿½ ï¿½298 192.168.0.2 TCP_MISS/200 2274 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749255 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.688 ï¿½ ï¿½305 192.168.0.2 TCP_MISS/200 2747 GET
> http://img11.allegroimg.pl/photos/64x48/10/52/72/84/1052728463 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.697 ï¿½ ï¿½318 192.168.0.2 TCP_MISS/200 1962 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748228 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.711 ï¿½ ï¿½334 192.168.0.2 TCP_MISS/200 2148 GET
> http://img14.allegroimg.pl/photos/64x48/10/47/74/07/1047740767 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.724 ï¿½ ï¿½ 62 192.168.0.2 TCP_MISS/200 2298 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/41/1048114124 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.736 ï¿½ ï¿½359 192.168.0.2 TCP_MISS/200 2206 GET
> http://img06.allegroimg.pl/photos/64x48/10/47/47/49/1047474911 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.749 ï¿½ ï¿½ 79 192.168.0.2 TCP_MISS/200 2562 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/41/1048114135 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.762 ï¿½ ï¿½ 83 192.168.0.2 TCP_MISS/200 2429 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/12/11/1048121165 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.773 ï¿½ ï¿½395 192.168.0.2 TCP_MISS/200 2564 GET
> http://img04.allegroimg.pl/photos/64x48/10/59/76/37/1059763730 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.785 ï¿½ ï¿½ 72 192.168.0.2 TCP_MISS/200 2130 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/20/1048252001 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.796 ï¿½ ï¿½ 71 192.168.0.2 TCP_MISS/200 2152 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/24/1048252448 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.806 ï¿½ ï¿½ 55 192.168.0.2 TCP_MISS/200 2470 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/49/1048254966 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.819 ï¿½ ï¿½ 46 192.168.0.2 TCP_MISS/200 2635 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/30/20/1048302014 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.833 ï¿½ ï¿½ 42 192.168.0.2 TCP_MISS/200 2120 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/36/39/1048363990 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.843 ï¿½ ï¿½ 43 192.168.0.2 TCP_MISS/200 2219 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/36/40/1048364001 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413781.456 ï¿½ 3073 192.168.0.2 TCP_MISS/200 2332 GET
> http://img11.allegroimg.pl/photos/64x48/10/52/73/36/1052733644 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413784.420 ï¿½ 6042 192.168.0.2 TCP_MISS/200 2431 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748244 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413790.419 ï¿½12041 192.168.0.2 TCP_MISS/200 2131 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748241 -
> DIRECT/194.0.251.214 image/jpeg
>
>
> ===========================
> SQUID SETTINGS
>
> http_port 8123 transparent
> cache_mgr tytan..._at_gmail.com
> visible_hostname sky-link.net
> error_directory /usr/share/squid/errors/Polish_clean
>
> cache_mem 1500 MB # ilosc ramu
> memory_pools on
> memory_pools_limit 100 MB
> cache_swap_low ï¿½94
> cache_swap_high 98
> fqdncache_size 51200
> ipcache_size 51200
> ipcache_low 90
> ipcache_high 95
> pipeline_prefetch on
> minimum_object_size 0 KB
> maximum_object_size 50000 KB
> maximum_object_size_in_memory 512 KB
> half_closed_clients on
> shutdown_lifetime 2 seconds
> #ident_timeout 1 seconds
> cache_replacement_policy heap LFUDA
> memory_replacement_policy heap lru
> #cache_dir aufs /mnt/dysk/squid 100000 256 256
> cache_dir aufs /mnt/dysk/squid 20000 32 256
> #quick_abort_min 200 KB
> #quick_abort_max 200 KB
> quick_abort_min 0 KB
> quick_abort_max 0 KB
>
> ### OPCJE ###
> icp_port 0
> htcp_port 0
> icp_access deny all
> htcp_access deny all
> snmp_port 0
> snmp_access deny all
>
> ### LOGI ###
> access_log /var/log/squid/access.log
> cache_log /var/log/squid/cache.log
> cache_store_log /var/log/squid/store.log
> log_fqdn on # pelne nazwy domen w logach
> #debug_options ALL,1
>
> ie_refresh on
> cache_effective_user squid
> cache_effective_group squid
> negative_ttl 1 minutes
> positive_dns_ttl 24 hours
> negative_dns_ttl 1 minutes
>
> ## ACL
> acl manager proto cache_object
> acl localhost src 127.0.0.1/255.255.255.255
> acl sky-link src 192.168.0.0/255.255.255.0 #Nasza LAN
> acl SSL_ports port 443 563
> acl Safe_ports port 21 80 442 563 70 210 280 488 591 777 1025-65535
> acl CONNECT method CONNECT
> #acl MCONN maxconn 300
> # Youtube ACL
> acl youtube_domains
> dstdomain .youtube.com .googlevideo.com .ytimg.com .wrzuta.pl
>
> ### ADL Blokada Reklam ###
> acl allowlist_urlregex url_regex "/etc/squid/acl/
> allowlist_urlregex.acl"
> acl allowlist_dstdomain dstdomain "/etc/squid/acl/
> allowlist_dstdomain.acl"
> acl denylist_urlregex url_regex "/etc/squid/acl/denylist_urlregex.acl"
> acl denylist_dstdomain dstdomain "/etc/squid/acl/
> denylist_dstdomain.acl"
>
> ## HTTP ACCESS
> http_access allow allowlist_dstdomain
> http_access allow allowlist_urlregex
> http_access deny denylist_urlregex
> http_access deny denylist_dstdomain
> http_access allow sky-link
> http_access allow manager localhost
> http_access deny manager
> http_access deny CONNECT !SSL_ports
> http_access deny !Safe_ports
> http_access deny youtube_domains
>
> #tcp_outgoing_address 79.190.121.50
> #zph_tos_local 8
> #zph_tos_peer 0
> #zph_tos_parent off
>
> #vary_ignore_expire on
> #relaxed_header_parser on
> #server_persistent_connections off
>
> request_header_max_size 100 KB
> refresh_pattern -i \.(gif|png|jpg|jpeg|ico|bmp)$ 10080 ï¿½90% ï¿½ ï¿½43200
> refresh-ims
> refresh_pattern -i \.(iso|avi|wav|ogg|mp3|mp4|mpg|mpeg|swf|flv|x-flv)$
> 10080 ï¿½90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern -i \.(deb|rpm|exe|zip|tar|gz|bz2|tgz|ram|rar|bin|ppt|
> doc|tiff)$ 10080 ï¿½90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ 10080
> 90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) ï¿½ ï¿½ ï¿½ ï¿½10080
> 90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|dll) 10080
> 90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern symantecliveupdate.com/.*\.(zip|exe) ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½10080
> 90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern windowsupdate.com/.*\.(cab|exe) ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ 10080
> 90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern download.microsoft.com/.*\.(cab|exe) ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½10080
> 90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern avast.com/.*\.(vpu|vpaa) ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½10080
> 90% ï¿½ ï¿½43200 refresh-ims
> refresh_pattern . ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ ï¿½ 0
> 90% ï¿½ ï¿½43200 refresh-ims
>
>
> --
> Z pozdrowieniami
> Tytus Rogalewski
> mail: tytanick{monkey}gmail.com
> www.sky-link.net
> gg: 210533
> skype: tytanick
>

-- 
Z pozdrowieniami
Tytus Rogalewski
mail: tytanick{monkey}gmail.com
www.sky-link.net
gg: 210533
skype: tytanick

Received on Tue Jun 01 2010 - 21:51:01 MDT

This archive was generated by hypermail 2.2.0 : Wed Jun 02 2010 - 12:00:03 MDT