Re: [squid-users] Squid eating too much memory

try decreasing the cache_mem !!

256mb maybe a good starting value !!

On 10/21/07, rihad <rihad@mail.ru> wrote:
> Tek Bahadur Limbu wrote:
> > Hi Rihad,
> >
> > rihad wrote:
> >> CacheMgr output:
> >> Memory accounted for:
> >> Total accounted: 1323944 KB
> >>
> >> Memory usage using top(1):
> >> PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU
> >> COMMAND
> >> 29601 squid 29 20 0 2533M 2465M kserel 92:12 0.00% squid
> >>
> >>
> >> Almost twice as much memory! Any hints?
> >
> > What is your settings for the following parameters?
> >
> > cache_mem
> > maximum_object_size
> > maximum_object_size_in_memory
> > cache_replacement_policy
> > memory_replacement_policy
> > ipcache_size
> > fqdncache_size
> >
> cache_mem 1000 MB
> maximum_object_size 100 MB
> # maximum_object_size_in_memory 8 KB
> cache_replacement_policy heap LFUDA
> memory_replacement_policy heap LFUDA
> # ipcache_size 1024
> # fqdncache_size 1024
>
> > Which storage scheme are you using?
> >
> aufs
>
> >>
> >> Number of clients accessing cache: 517
> >> Normally load is within 500-1500 clients.
> >
> > How long is your Squid process been running?
> >
> 3 to 4 days, but it doesn't matter: I've had weeks or months of uptime,
> too. Eventually the process hits its memory size limit (kern.maxdsiz)
> set at 2.5 gigs at the moment and croaks (and restarts) unless I
> decrease cache_mem. There's little point in using less RAM as the box
> has ~3.3 gigs of it, and is dedicated to Squid (and its dedicated dnscache).
>
> > Your server's memory usage seems unusually high even for 1500 clients.
> > My proxy server which serves 2000-3000 clients is currently using 650 MB
> > of memory despite running for more than 55 days.
> >
> How big is your cache store?
>
> >
> >>
> >> Squid 2.6.16
> >> FreeBSD 6.2-RELEASE-p8
> >
> > What is your machines specs?
> >
> # grep -e ^CPU: -e memory -e ^ad /var/run/dmesg.boot
> CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2813.85-MHz 686-class CPU)
> real memory = 3489595392 (3327 MB)
> avail memory = 3414970368 (3256 MB)
> ad4: 238475MB <Seagate ST3250824AS 3.AAE> at ata2-master SATA150
> ad6: 238475MB <Seagate ST3250824AS 3.AAE> at ata3-master SATA150
>
> Two cache_dir's lie on both disks (25 gigs each at the moment, but I'm
> planning for more).
>
> >>
> >> Port compiled with all options unchecked and both AUFS & KQUEUE checked
> >> (as per "make config" and /var/db/ports/squid/options)
> >
> > Can you post the full output of "squidclient mgr:info"?
> >
> Squid Object Cache: Version 2.6.STABLE16
> Start Time: Thu, 18 Oct 2007 17:10:09 GMT
> Current Time: Sun, 21 Oct 2007 09:39:51 GMT
> Connection information for squid:
> Number of clients accessing cache: 517
> Number of HTTP requests received: 9410288
> Number of ICP messages received: 0
> Number of ICP messages sent: 0
> Number of queued ICP replies: 0
> Request failure ratio: 0.00
> Average HTTP requests per minute since start: 2431.8
> Average ICP messages per minute since start: 0.0
> Select loop called: 74113837 times, 3.133 ms avg
> Cache information for squid:
> Request Hit Ratios: 5min: 35.6%, 60min: 37.1%
> Byte Hit Ratios: 5min: 21.4%, 60min: 18.1%
> Request Memory Hit Ratios: 5min: 12.0%, 60min: 15.0%
> Request Disk Hit Ratios: 5min: 22.9%, 60min: 26.2%
> Storage Swap size: 22427274 KB
> Storage Mem size: 1023900 KB
> Mean Object Size: 13.62 KB
> Requests given to unlinkd: 0
> Median Service Times (seconds) 5 min 60 min:
> HTTP Requests (All): 0.08265 0.08265
> Cache Misses: 0.17711 0.18699
> Cache Hits: 0.00463 0.00562
> Near Hits: 0.12106 0.14252
> Not-Modified Replies: 0.00286 0.00379
> DNS Lookups: 0.11405 0.10906
> ICP Queries: 0.00000 0.00000
> Resource usage for squid:
> UP Time: 232181.468 seconds
> CPU Time: 5971.253 seconds
> CPU Usage: 2.57%
> CPU Usage, 5 minute avg: 3.98%
> CPU Usage, 60 minute avg: 3.55%
> Process Data Segment Size via sbrk(): -1583756 KB
> Maximum Resident Size: 2549632 KB
> Page faults with physical i/o: 3799
> Memory accounted for:
> Total accounted: 1333488 KB
> memPoolAlloc calls: 1090270339
> memPoolFree calls: 1082572188
> File descriptor usage for squid:
> Maximum number of file descriptors: 11072
> Largest file desc currently in use: 1715
> Number of file desc currently in use: 1622
> Files queued for open: 0
> Available number of file descriptors: 9450
> Reserved number of file descriptors: 100
> Store Disk files open: 41
> IO loop method: kqueue
> Internal Data Structures:
> 1652462 StoreEntries
> 200285 StoreEntries with MemObjects
> 200125 Hot Object Cache Items
> 1646504 on-disk objects
>
>
> >
> > Thanking you...
> >
> Thank you too!
>

-- 
Sds.
Alexandre J. Correa
Onda Internet / OPinguim.net
http://www.ondainternet.com.br
http://www.opinguim.net