Re: [squid-users] Re: reduce wan link traffic--> query

From: Joel n.solanki <[email protected]>
Date: 05 Oct 2004 09:30:38 +0530

Helo ..

yes i m using calamaris.
but i cant find that option whihc u told me in the mail.
therefore i have given here the reports of calamaris and plz tell me
where do i look for bandwidth saving parameter.
it will be real good for yur help.

thanks

Summary
lines parsed:
                               50000
invalid lines:
                                   0
unique hosts/users:
                                  44
parse time (sec):
                                  26

Back to Top

________________________________________________________________________
Incoming requests by method
  method
 request
    %
   Byte
    %
   sec
  kB/sec

GET
     44942
     89.88
   421559K
     97.13
         2
      4.38
POST
      3899
      7.80
   9940242
      2.24
         2
      0.94
PROPFIND
       428
      0.86
   2001775
      0.45
         1
      3.27
NONE
       411
      0.82
    656778
      0.15
         0
   1037.50
HEAD
       239
      0.48
     73371
      0.02
         0
      0.76
OPTIONS
        75
      0.15
     99759
      0.02
        30
      0.04
PROPPATCH
         5
      0.01
      3908
      0.00
         0
      0.77
MOVE
         1
      0.00
       544
      0.00
         0
      0.73

Sum
     50000
    100.00
   434036K
    100.00
         2
      3.96

Back to Top

________________________________________________________________________
Incoming UDP-requests by status
no matching requests

Back to Top

________________________________________________________________________
Incoming TCP-requests by status
  status
 request
    %
   Byte
    %
   sec
  kB/sec

HIT
     13988
     27.98
  44213412
      9.95
         0
      6.71
  TCP_IMS_HIT
      7594
     15.19
   1782442
      0.40
         0
      7.52
  TCP_HIT
      4443
      8.89
  32078598
      7.22
         1
      6.28
  TCP_REFRESH_HIT
       944
      1.89
   3033701
      0.68
         0
      4.81
  TCP_MEM_HIT
       853
      1.71
   7062531
      1.59
         0
     11.84
  TCP_NEGATIVE_HIT
       154
      0.31
    256140
      0.06
         0
     26.80
MISS
     35082
     70.16
   388876K
     89.60
         2
      3.92
  TCP_MISS
     33357
     66.71
   381773K
     87.96
         2
      3.89
  TCP_CLIENT_REFRESH_MISS
      1531
      3.06
   5926739
      1.33
         0
      6.40
  TCP_REFRESH_MISS
       194
      0.39
   1346589
      0.30
         0
      8.36
ERROR
       930
      1.86
   2030819
      0.46
         4
      0.50
  TCP_MISS
       478
      0.96
   1328345
      0.30
         8
      0.33
  NONE
       428
      0.86
    682650
      0.15
         0
    982.83
  TCP_DENIED
        13
      0.03
     18277
      0.00
         0
     12.09
  TCP_CLIENT_REFRESH_MISS
         6
      0.01
      1547
      0.00
         2
      0.10
  TCP_REFRESH_MISS
         5
      0.01
         0
      0.00
         1
      0.00

Sum
     50000
    100.00
   434036K
    100.00
         2
      3.96

Back to Top

________________________________________________________________________
Outgoing requests by status
  status
 request
    %
   Byte
    %
   sec
  kB/sec

DIRECT
Fetch from
Source
     36023
    100.00
   391822K
    100.00
         2
      3.92
  DIRECT
     36023
    100.00
   391822K
    100.00
         2
      3.92
SIBLING
         0
      0.00
         0
      0.00
         0
      0.00
PARENT
         0
      0.00
         0
      0.00
         0
      0.00

Sum
     36023
    100.00
   391822K
    100.00
         2
      3.92

Back to Top

________________________________________________________________________
Outgoing requests by destination
 neighbor
   type
 request
    %
   Byte
    %
   sec
  kB/sec

DIRECT
     36023
    100.00
   391822K
    100.00
         2
      3.92

Sum
     36023
    100.00
   391822K
    100.00
         2
      3.92

Back to Top

________________________________________________________________________
Request-destinations by 2nd-level-domain
destination
  request
     %
    Byte
     %
   hit-%

*.yahoo.com
        6162
       12.32
    31008452
        6.98
        1.01
*.yimg.com
        3554
        7.11
    18910068
        4.25
       64.21
*.indiatimes.com
        2164
        4.33
     7966694
        1.79
       42.79
*.co.in
        2123
        4.25
    10749851
        2.42
       29.63
<error>
        1741
        3.48
     3702043
        0.83
        8.39
*.rediff.com
        1672
        3.34
     6948499
        1.56
       29.37
*.msn.com
        1531
        3.06
     7935666
        1.79
       12.41
*.microsoft.com
        1469
        2.94
    43818977
        9.86
       23.08
*.indianfriendfinder.com
        1404
        2.81
     2028232
        0.46
       48.15
64.4.55.*
        1277
        2.55
      462620
        0.10
       90.84
*.imperial.ac.uk
         612
        1.22
     1686053
        0.38
       65.20
202.160.161.*
         577
        1.15
     1293511
        0.29
       31.20
*.akamai.net
         534
        1.07
      450798
        0.10
       72.28
*.raaga.com
         534
        1.07
     1078230
        0.24
       60.49
*.asiafriendfinder.com
         485
        0.97
      113764
        0.03
       45.36
*.gator.com
         448
        0.90
      960987
        0.22
       48.44
*.ofoto.com
         434
        0.87
     3484132
        0.78
        8.29
*.mediaturf.net
         362
        0.72
     1393377
        0.31
        8.01
*.baazee.com
         359
        0.72
     1385740
        0.31
       17.27
*.advertising.com
         318
        0.64
     1200122
        0.27
        0.63
other: 971
2nd-level-domains
       22240
       44.48
     290894K
       67.02
       23.53

Sum
       50000
      100.00
     434036K
      100.00
       27.98

Back to Top

________________________________________________________________________
Request-destinations by toplevel-domain
destination
  request
     %
    Byte
     %
   hit-%

*.com
       37881
       75.76
     339610K
       78.24
       26.72
*.net
        2716
        5.43
    17033899
        3.83
       29.01
<unresolved>
        2615
        5.23
    30927163
        6.96
       55.45
*.in
        2314
        4.63
    11524927
        2.59
       32.07
<error>
        1741
        3.48
     3702043
        0.83
        8.39
*.uk
         767
        1.53
     2948846
        0.66
       53.46
*.ca
         405
        0.81
     1636796
        0.37
       21.48
*.org
         370
        0.74
     4113520
        0.93
        6.76
*.de
         269
        0.54
      769096
        0.17
       24.91
*.au
         170
        0.34
      613019
        0.14
       25.88
*.gr
          94
        0.19
      359864
        0.08
       36.17
*.za
          72
        0.14
      707235
        0.16
        5.56
*.es
          67
        0.13
      528639
        0.12
        0.00
*.jp
          62
        0.12
    11917332
        2.68
        0.00
*.ws
          55
        0.11
      787450
        0.18
        0.00
*.info
          48
        0.10
       14529
        0.00
       87.50
*.edu
          41
        0.08
      681737
        0.15
        0.00
*.br
          38
        0.08
       92393
        0.02
        0.00
*.gov
          36
        0.07
     1099838
        0.25
        0.00
*.tw
          32
        0.06
       65727
        0.01
        6.25
other: 18
top-level-domains
         207
        0.41
     7168894
        1.61
       11.59

Sum
       50000
      100.00
     434036K
      100.00
       27.98

Back to Top

________________________________________________________________________
TCP-Request-protocol
  protocol
  request
     %
    Byte
     %
   hit-%

http:
       48259
       96.52
     430421K
       99.17
       28.68
<error>
        1741
        3.48
     3702043
        0.83
        8.39

Sum
       50000
      100.00
     434036K
      100.00
       27.98

Back to Top

________________________________________________________________________
Requested content-type
content-type
  request
     %
    Byte
     %
   hit-%

image/gif
       14691
       29.38
    31512529
        7.09
       56.26
text/html
       11756
       23.51
    81800565
       18.40
        5.50
image/jpeg
        5405
       10.81
    59681923
       13.43
       20.35
<unknown>
        4459
        8.92
     2267701
        0.51
        5.81
text/plain
        3877
        7.75
    26340873
        5.93
        5.26
application/x-javascript
        2892
        5.78
     7990817
        1.80
       55.12
<error>
        1629
        3.26
     2577946
        0.58
        8.96
text/css
        1126
        2.25
     2837929
        0.64
       65.36
application/octet-stream
         773
        1.55
    72739881
       16.37
       41.66
text/xml
         736
        1.47
     4903453
        1.10
        1.22
image/png
         576
        1.15
     1432172
        0.32
       32.99
application/x-shockwave-flash
         567
        1.13
    12691390
        2.86
       31.57
application/x-msdownload
         398
        0.80
    27198186
        6.12
        0.00
video/mpeg
         192
        0.38
    50036513
       11.26
        8.33
application/x-msn-messenger
         191
        0.38
       76282
        0.02
        0.00
application/zip
         166
        0.33
    20506436
        4.61
       65.06
image/x-icon
         120
        0.24
       34074
        0.01
       95.00
text/javascript
          68
        0.14
      167929
        0.04
        0.00
image/bmp
          39
        0.08
      328599
        0.07
       51.28
application/x-gzip
          38
        0.08
     2930511
        0.66
        5.26
other: 38
content-types
         301
        0.60
    36397385
        8.19
       25.58

Sum
       50000
      100.00
     434036K
      100.00
       27.98

Back to Top

________________________________________________________________________
Requested extensions
 extensions
  request
     %
    Byte
     %
   hit-%

<dynamic>
       16785
       33.57
     149580K
       34.46
        0.40
gif
       15585
       31.17
    29988919
        6.75
       54.42
jpg
        4747
        9.49
    53040324
       11.93
       22.06
js
        2296
        4.59
     4490820
        1.01
       70.21
<error>
        1741
        3.48
     3702043
        0.83
        8.39
<none>
        1675
        3.35
    13959566
        3.14
        6.51
css
        1297
        2.59
     2491090
        0.56
       58.60
html
        1103
        2.21
     7763019
        1.75
       18.50
htm
         825
        1.65
     4504094
        1.01
       18.91
png
         730
        1.46
     1288259
        0.29
       45.34
EXE
         368
        0.74
     5402791
        1.22
        0.00
swf
         301
        0.60
     5824749
        1.31
       67.77
asp
         283
        0.57
     3124032
        0.70
        0.00
ini
         246
        0.49
     1087950
        0.24
       58.94
cab
         195
        0.39
     4027186
        0.91
       62.56
php
         155
        0.31
     1021201
        0.23
        1.94
ico
         144
        0.29
       60842
        0.01
       84.72
zip
         127
        0.25
    20380468
        4.59
       77.95
class
         109
        0.22
       68977
        0.02
        5.50
CAB
         100
        0.20
      310963
        0.07
       24.00
other: 92
extensions
        1188
        2.38
     125728K
       28.97
       29.38

Sum
       50000
      100.00
     434036K
      100.00
       27.98

Distribution Histogram
object-size (bytes)
 request
  hit-%
   Byte
  hit-%
   sec
  kB/sec

0-0
       560
      1.61
         0
      0.00
         3
      0.00
10-99
        47
      0.00
      4042
      0.00
         1
      0.07
100-999
     26887
     39.64
  10897865
     29.32
         0
      0.78
1000-9999
     16377
     16.23
  56196634
     15.86
         1
      3.01
10000-99999
      5717
     10.79
   140735K
      9.35
         5
      4.13
100000-999999
       369
     11.92
  99369709
     14.93
        44
      5.92
1000000-9999999
        42
      4.76
   116227K
      3.19
       585
      4.72
10000000-99999999
         1
      0.00
  14855473
      0.00
       781
     18.57

Sum
     50000
     27.98
   434036K
      9.95
         2
      3.96

Back to Top

________________________________________________________________________
Performance in 1 hour steps
    
    
    
incomin
  hit
  miss
 direct
sibling
 fetch
  date
request
  Byte
 kB/sec
 kB/sec
 kB/sec
 kB/sec
 kB/sec
 kB/sec

04.Oct
04 22:30
   13181
     97M
    2.99
    1.71
    3.18
    3.18
 
 
04.Oct
04 23:30
   11162
    125M
    3.71
    8.94
    3.52
    3.52
 
 
05.Oct
04 00:30
    3888
     41M
    4.54
    7.66
    4.29
    4.29
 
 
05.Oct
04 01:30
    1297
     19M
   14.04
   31.79
   11.89
   11.80
 
 
05.Oct
04 02:30
    1005
     23M
    5.23
   13.78
    5.14
    5.15
 
 
05.Oct
04 03:30
     360
     16M
    6.62
   10.76
    6.57
    6.56
 
 
05.Oct
04 04:30
    1199
   4500K
    1.88
    5.77
    1.79
    1.80
 
 
05.Oct
04 05:30
     277
    949K
    3.24
    2.70
    5.71
    4.87
 
 
05.Oct
04 06:30
    1040
   5661K
    5.58
    5.93
    6.12
    6.24
 
 
05.Oct
04 07:30
    4734
     31M
    4.87
   11.69
    4.59
    4.63
 
 
05.Oct
04 08:30
   11857
     61M
    4.42
   20.26
    4.71
    4.72
 
 

overall
   50000
    424M
    3.96
    6.71
    3.92
    3.92
 
 

Back to Top

Back to Top

On Tue, 2004-10-05 at 07:24, Adam Aube wrote:
> Joel n.solanki wrote:
>
> > Now i want to test wheather it is reducing the overall bandwidth or not.
> > my squidclient mgr_client_list tell me this
> >
> > HTTP: 195075 Requests, 57193 Hits ( 29%)
> >
> > So i guess hits is the bandwidth saving. M i right ?
>
> No. This is the percentage of requests, not bytes, that have been served
> from the cache. For bandwidth savings, you need to measure the bytes.
>
> I would suggest using Calamaris (linked to from the Squid website, under
> Logfile Analysis). It parses your access.log and gives a variety of useful
> statistics, including bandwidth savings (the byte percentage of HITs).
>
> Adam

-- 
Joel N.Solanki
Network Administrator
Mobile: 91-9426353268
Phone No: 0265-550001/2/3/4/5 Ext: 211/212
Digtial 2 Virtual Internet Service Provider.
http://www.packetraptor.com/
http://www.d2visp.com/
Gujarat (India)
Received on Mon Oct 04 2004 - 21:58:19 MDT

This archive was generated by hypermail pre-2.1.9 : Mon Nov 01 2004 - 12:00:01 MST