[squid-users] Re: cache_dir amendment

I did some changes by changing

1) File Descriptors
/* Number of descriptors that can fit in an `fd_set'. */
#define __FD_SETSIZE 8192

2) ulimit prior to squid startup
ulimit -HSn 16384

restart the cache box cleanly, but cache.log shows

2001/11/28 13:43:57| Starting Squid Cache version 2.4.STABLE2 for i686-pc-linux-gnu...
2001/11/28 13:43:57| Process ID 729
2001/11/28 13:43:57| With 1024 file descriptors available
2001/11/28 13:43:57| DNS Socket created on FD 4
2001/11/28 13:43:57| helperOpenServers: Starting 10 'squirm' processes
2001/11/28 13:43:57| Unlinkd pipe opened on FD 19
2001/11/28 13:43:57| Swap maxSize 50331648 KB, estimated 3871665 objects
2001/11/28 13:43:57| Target number of buckets: 193583
2001/11/28 13:43:57| Using 262144 Store buckets
2001/11/28 13:43:57| Max Mem size: 65536 KB
2001/11/28 13:43:57| Max Swap size: 50331648 KB
2001/11/28 13:43:57| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2001/11/28 13:43:57| Rebuilding storage in /directory1 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory2 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory3 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory4 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory5 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory6 (DIRTY)
2001/11/28 13:43:57| Using Least Load store dir selection
2001/11/28 13:43:57| Set Current Directory to /directory1
2001/11/28 13:43:57| Loaded Icons.
2001/11/28 13:43:57| Accepting HTTP connections at 0.0.0.0, port 8080, FD 36.
2001/11/28 13:43:57| Accepting ICP messages at 0.0.0.0, port 3130, FD 38.
2001/11/28 13:43:57| Accepting SNMP messages on port 3401, FD 39.
2001/11/28 13:43:57| WCCP Disabled.
2001/11/28 13:43:57| WARNING: Peer looks like this host
2001/11/28 13:43:57| Ready to serve requests.
2001/11/28 13:43:57| Done reading /directory6 swaplog (2397 entries)
2001/11/28 13:43:57| Done reading /directory2 swaplog (2509 entries)
2001/11/28 13:43:57| Done reading /directory3 swaplog (2732 entries)
2001/11/28 13:43:57| Done reading /directory4 swaplog (2753 entries)
2001/11/28 13:43:57| Done reading /directory1 swaplog (2829 entries)
2001/11/28 13:43:57| Done reading /directory5 swaplog (3264 entries)
2001/11/28 13:43:57| Finished rebuilding storage from disk.
2001/11/28 13:43:57| 15491 Entries scanned
2001/11/28 13:43:57| 0 Invalid entries.
2001/11/28 13:43:57| 0 With invalid flags.
2001/11/28 13:43:57| 14526 Objects loaded.
2001/11/28 13:43:57| 0 Objects expired.
2001/11/28 13:43:57| 931 Objects cancelled.
2001/11/28 13:43:57| 64 Duplicate URLs purged.
2001/11/28 13:43:57| 4 Swapfile clashes avoided.
2001/11/28 13:43:57| Took 0.0 seconds (14526.0 objects/sec).
2001/11/28 13:43:57| Beginning Validation Procedure
2001/11/28 13:43:57| Completed Validation Procedure
2001/11/28 13:43:57| Validated 14492 Entries
2001/11/28 13:43:57| store_swap_size = 200396k
2001/11/28 13:44:04| storeLateRelease: released 0 objects

not sure what really went wrong with respect to :

1)2001/11/28 13:43:57| With 1024 file descriptors available
   - which I thought that I would see 8192?

2) 2001/11/28 13:43:57| Rebuilding storage in /directory1 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory2 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory3 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory4 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory5 (DIRTY)
2001/11/28 13:43:57| Rebuilding storage in /directory6 (DIRTY)

- which I restart squid cleanly?

pse help! tks.

Rgds,

Irwin

  ----- Original Message -----
  From: Irwin Soo
  To: squid-users@squid-cache.org
  Sent: Tuesday, November 27, 2001 10:30 PM
  Subject: cache_dir amendment

  Hi all,

  I'm a newbie here...

  I 'm running squid2.4stable2 on RH7.1, here are some of my config before posing my questions here:-

  1) cache partition
  /dev/sdb1 53G 542M 49G 2% /directory1
  /dev/sdb5 53G 542M 49G 2% /directory2
  /dev/sdb6 53G 544M 49G 2% /directory3
  /dev/sdb7 53G 543M 49G 2% /directory4
  /dev/sdb8 53G 542M 49G 2% /directory5
  /dev/sdb9 53G 542M 49G 2% /directory6

  2) File Descriptors
  /* Number of descriptors that can fit in an `fd_set'. */
  #define __FD_SETSIZE 16384

  3) ulimit prior to squid startup
  ulimit -HSn 32768

  4) max limit in /etc/sysctl.conf
  # Increase file_max(/proc/sys/fs/file-max) size automatically
  fs.file-max = 32768

  Q: any serious misconfig from the above?

  In my squid.conf

  #Default:
  # cache_dir ufs /usr/local/squid/cache 100 16 256
  # cache_dir diskd /usr/local/squid/cache 8192 128 1024 Q1=72 Q2=96
   cache_dir diskd /directory1 8192 128 1024 Q1=72 Q2=96
   cache_dir diskd /directory2 8192 128 1024 Q1=72 Q2=96
   cache_dir diskd /directory3 8192 128 1024 Q1=72 Q2=96
   cache_dir diskd /directory4 8192 128 1024 Q1=72 Q2=96
   cache_dir diskd /directory5 8192 128 1024 Q1=72 Q2=96
   cache_dir diskd /directory6 8192 128 1024 Q1=72 Q2=96

  with each physical cache partition to be 49GB, seemed like I only allocated 8GB out of each,
  with directory and sub-directory to be 128 and 1024 respectively.

  If I want to rectify my cache directory, is reinstallation the only resort? or I can perform steps
  e.g. changes to cache_dir in squid.conf, recompile, restart squid as a alternative to reinstallation?
         

  # Q1 specifies the number of unacknowledged I/O requests when Squid
  # stops opening new files. If this many messages are in the queues,
  # Squid won't open new files. Default is 64
  #
  # Q2 specifies the number of unacknowledged messages when Squid
  # starts blocking. If this many messages are in the queues,
  # Squid blocks until it recevies some replies. Default is 72

  What are the considerations besides using the default values to directories, subdirectories and Q1/Q2 settings
  taking into consideration read/write optimisation? I'm struggling to understand the description of Q!/Q2 in simpler terms.
  appreciate your help here.

  p.s. my h/w spec.(s) Intel PIII 1GB, 2GB RAM, 5x73GB cache data allocation(exclusive of OS, RAID5)

  Thank you.

  Rgds,

  Irwin
Received on Tue Nov 27 2001 - 22:57:14 MST