Re: [squid-users] inode ratio and block-size

Hi Man,

Linux Man wrote:
> Thanks for you help
>
> Well, I'll use it for cache web traffic, thus save bandwidth.
> The cache dir will have 50 GB, and the linux box 2 GB RAM.
> I think that while coss is under development, diskd is a good
> alternative, so that is will I use.

Which Squid version and Operating system is your Squid cache running on?

 From my experience with COSS, I don't think that COSS is unstable, at
least for my Squid caches. Below is the status of one of my Squid cache
using COSS.

[root@cache8 ~]# squidclient mgr:info

HTTP/1.0 200 OK
Server: squid
Date: Thu, 10 Jan 2008 15:17:39 GMT
Content-Type: text/plain
Expires: Thu, 10 Jan 2008 15:17:39 GMT
Last-Modified: Thu, 10 Jan 2008 15:17:39 GMT
X-Cache: MISS from cache8.myhost.com
X-Cache-Lookup: MISS from cache8.myhost.com:3128
Via: 1.0 cache8.myhost.com:3128 (squid)
Proxy-Connection: close

Squid Object Cache: Version 2.6.STABLE16
Start Time: Sun, 09 Sep 2007 11:31:49 GMT
Current Time: Thu, 10 Jan 2008 15:17:39 GMT
Connection information for squid:
         Number of clients accessing cache: 5458
         Number of HTTP requests received: 646905419
         Number of ICP messages received: 3418793728
         Number of ICP messages sent: 3443241002
         Number of queued ICP replies: 1725
         Request failure ratio: 0.00
         Average HTTP requests per minute since start: 3647.7
         Average ICP messages per minute since start: -9743.1
         Select loop called: 1343923409 times, 7.918 ms avg
Cache information for squid:
         Request Hit Ratios: 5min: 30.4%, 60min: 35.5%
         Byte Hit Ratios: 5min: 13.2%, 60min: 17.8%
         Request Memory Hit Ratios: 5min: 0.5%, 60min: 0.5%
         Request Disk Hit Ratios: 5min: 64.0%, 60min: 62.2%
         Storage Swap size: 7539358 KB
         Storage Mem size: 62772 KB
         Mean Object Size: 8.74 KB
         Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
         HTTP Requests (All): 1.24267 1.24267
         Cache Misses: 1.54242 1.46131
         Cache Hits: 0.01164 0.01035
         Near Hits: 1.24267 1.31166
         Not-Modified Replies: 0.00179 0.00091
         DNS Lookups: 0.00190 0.00190
         ICP Queries: 0.00108 0.00108
Resource usage for squid:
         UP Time: 10640749.431 seconds
         CPU Time: 776356.607 seconds
         CPU Usage: 7.30%
         CPU Usage, 5 minute avg: 0.00%
         CPU Usage, 60 minute avg: 0.00%
         Process Data Segment Size via sbrk(): 1267032 KB
         Maximum Resident Size: 558596 KB
         Page faults with physical i/o: 7602194
Memory accounted for:
         Total accounted: 635652 KB
         memPoolAlloc calls: 1433656781
         memPoolFree calls: 1427221210
File descriptor usage for squid:
         Maximum number of file descriptors: 8192
         Largest file desc currently in use: 1659
         Number of file desc currently in use: 1444
         Files queued for open: 0
         Available number of file descriptors: 6748
         Reserved number of file descriptors: 100
         Store Disk files open: 0
         IO loop method: kqueue
Internal Data Structures:
         863282 StoreEntries
           1952 StoreEntries with MemObjects
           1215 Hot Object Cache Items
         862395 on-disk objects

As you can see from the above stats, this cache utilizing the COSS
storage scheme has been running up without downtime since 09-Sep-2007!

> With an average of 13KB is a good choice a block size of 4KB?

I suggest using 2 cache directories schemes for your Squid box. The 1st
for COSS and the 2nd for AUFS or DISKD.

But I think that AUFS is more suitable for Linux though.

Thanking you...

>
> Thanks a lot
> Best regards
>
>
>
> 2008/1/8, Matus UHLAR - fantomas <uhlar@fantomas.sk>:
>> On 08.01.08 00:42, Linux Man wrote:
>>> In your experience, when you make a new fs (I will use ext3) for cache
>>> dir, what block-size and inode ratio do you use?
>> depends on usage, but the average file size is usually around 13KB which may
>> tell enough...
>>
>> using COSS for small files should change this a lot, however COSS is still
>> not stable enough iirc
>>
>> --
>> Matus UHLAR - fantomas, [email protected] ; http://www.fantomas.sk/
>> Warning: I wish NOT to receive e-mail advertising to this address.
>> Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
>> Eagles may soar, but weasels don't get sucked into jet engines.
>>
>
>
>
>

-- 
With best regards and good wishes,
Yours sincerely,
Tek Bahadur Limbu
System Administrator
(TAG/TDG Group)
Jwl Systems Department
Worldlink Communications Pvt. Ltd.
Jawalakhel, Nepal
http://www.wlink.com.np
http://teklimbu.wordpress.com