Re: [squid-users] COSS trouble revisited ...

* On 05/11/06 19:22 +0100, Guido Serassio wrote:
| Hi,
|
| At 18.26 05/11/2006, Odhiambo WASHINGTON wrote:
|
| >As recommended, I have started with just one cache_dir
| >
| >cache_dir coss /usr/local/squid/coss1 5120 max-size=131072
| >
| >(I recreated the files in a different location)
| >
| >...but Squid still core dump:
|
| What is the exact error ?

There is no exact error. I'd say it dies so peacefully without writing
anything in the cache.log

[snip]

| If I'm not wrong, this should be the first read from the stripe file,
| offset is 0.
| Looks like aio_read() doesn't work on your system.
|
| Looking to FreeBSD man pages:
|
| "To link into the kernel:
| options VFS_AIO"
|
| and
|
| "To load as a kernel loadable module:
| kldload aio"
|
| and
|
| "The aio facility provides system calls for asynchronous I/O. It is
| available both as a kernel option for static inclusion and as a dynamic
| kernel module."
|
| You can also try building Squid without the --enable-coss-aio-ops
| configure option.

I loaded the aio modules

Well, you seem to stopped the culprit dead on it's track ;)

I loaded the aio module using kldload, and ..........

2006/11/05 22:26:22| Starting Squid Cache version 2.6.STABLE4 for i386-portbld-freebsd6.2...
2006/11/05 22:26:22| Process ID 1708
2006/11/05 22:26:22| With 8960 file descriptors available
2006/11/05 22:26:22| Using kqueue for the IO loop
2006/11/05 22:26:22| DNS Socket created at 0.0.0.0, port 58008, FD 5
2006/11/05 22:26:22| Adding nameserver 127.0.0.1 from /etc/resolv.conf
2006/11/05 22:26:22| Adding nameserver 192.168.51.1 from /etc/resolv.conf
2006/11/05 22:26:22| User-Agent logging is disabled.
2006/11/05 22:26:22| Referer logging is disabled.
2006/11/05 22:26:22| Unlinkd pipe opened on FD 10
2006/11/05 22:26:22| Swap maxSize 15728640 KB, estimated 1209895 objects
2006/11/05 22:26:22| Target number of buckets: 60494
2006/11/05 22:26:22| Using 65536 Store buckets
2006/11/05 22:26:22| Max Mem size: 131072 KB
2006/11/05 22:26:22| Max Swap size: 15728640 KB
2006/11/05 22:26:22| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2006/11/05 22:26:22| Store logging disabled
2006/11/05 22:26:22| Rebuilding COSS storage in /usr/local/squid/coss1 (DIRTY)
2006/11/05 22:26:22| Rebuilding storage in /usr/local/squid/cache1 (DIRTY)
2006/11/05 22:26:22| Rebuilding storage in /usr/local/squid/cache2 (DIRTY)
2006/11/05 22:26:22| Using Least Load store dir selection
2006/11/05 22:26:22| Set Current Directory to /usr/local/squid/logs
2006/11/05 22:26:22| Loaded Icons.
2006/11/05 22:26:22| Accepting transparently proxied HTTP connections at 0.0.0.0, port 3128, FD 17.
2006/11/05 22:26:22| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2006/11/05 22:26:22| Accepting HTCP messages on port 4827, FD 19.
2006/11/05 22:26:22| WCCP Disabled.
2006/11/05 22:26:22| Ready to serve requests.
2006/11/05 22:26:22| COSS: /usr/local/squid/coss1: Rebuilding (0 % completed - 1/5120 stripes)
2006/11/05 22:26:23| Store rebuilding is 18.6% complete
2006/11/05 22:26:23| Done reading /usr/local/squid/cache2 swaplog (6903 entries)
2006/11/05 22:26:23| Done reading /usr/local/squid/cache1 swaplog (22056 entries)
2006/11/05 22:26:29| COSS: /usr/local/squid/coss1: Rebuilding (5 % completed - 257/5120 stripes)
2006/11/05 22:26:36| COSS: /usr/local/squid/coss1: Rebuilding (10 % completed - 513/5120 stripes)
2006/11/05 22:26:43| COSS: /usr/local/squid/coss1: Rebuilding (15 % completed - 769/5120 stripes)
2006/11/05 22:26:43| parseHttpRequest: NAT open failed: (13) Permission denied
2006/11/05 22:26:49| COSS: /usr/local/squid/coss1: Rebuilding (20 % completed - 1025/5120 stripes)
2006/11/05 22:26:56| COSS: /usr/local/squid/coss1: Rebuilding (25 % completed - 1281/5120 stripes)
2006/11/05 22:27:03| COSS: /usr/local/squid/coss1: Rebuilding (30 % completed - 1537/5120 stripes)
2006/11/05 22:27:10| COSS: /usr/local/squid/coss1: Rebuilding (35 % completed - 1793/5120 stripes)
2006/11/05 22:27:16| COSS: /usr/local/squid/coss1: Rebuilding (40 % completed - 2049/5120 stripes)
2006/11/05 22:27:23| COSS: /usr/local/squid/coss1: Rebuilding (45 % completed - 2305/5120 stripes)
2006/11/05 22:27:30| COSS: /usr/local/squid/coss1: Rebuilding (50 % completed - 2561/5120 stripes)
2006/11/05 22:27:36| COSS: /usr/local/squid/coss1: Rebuilding (55 % completed - 2817/5120 stripes)
2006/11/05 22:27:42| COSS: /usr/local/squid/coss1: Rebuilding (60 % completed - 3073/5120 stripes)
2006/11/05 22:27:49| COSS: /usr/local/squid/coss1: Rebuilding (65 % completed - 3329/5120 stripes)
2006/11/05 22:27:55| COSS: /usr/local/squid/coss1: Rebuilding (70 % completed - 3585/5120 stripes)
2006/11/05 22:28:01| COSS: /usr/local/squid/coss1: Rebuilding (75 % completed - 3841/5120 stripes)
2006/11/05 22:28:07| COSS: /usr/local/squid/coss1: Rebuilding (80 % completed - 4097/5120 stripes)
2006/11/05 22:28:14| COSS: /usr/local/squid/coss1: Rebuilding (85 % completed - 4353/5120 stripes)
2006/11/05 22:28:21| COSS: /usr/local/squid/coss1: Rebuilding (90 % completed - 4609/5120 stripes)
2006/11/05 22:28:27| COSS: /usr/local/squid/coss1: Rebuilding (95 % completed - 4865/5120 stripes)
2006/11/05 22:28:32| Finished rebuilding storage from disk.
2006/11/05 22:28:32| 28944 Entries scanned
2006/11/05 22:28:32| 0 Invalid entries.
2006/11/05 22:28:32| 0 With invalid flags.
2006/11/05 22:28:32| 28944 Objects loaded.
2006/11/05 22:28:32| 0 Objects expired.
2006/11/05 22:28:32| 0 Objects cancelled.
2006/11/05 22:28:32| 11 Duplicate URLs purged.
2006/11/05 22:28:32| 0 Swapfile clashes avoided.
2006/11/05 22:28:32| Took 130.2 seconds ( 222.3 objects/sec).
2006/11/05 22:28:32| Beginning Validation Procedure
2006/11/05 22:28:32| COSS: /usr/local/squid/coss1: Rebuild Completed
2006/11/05 22:28:32| 0 objects scanned, 0 objects relocated, 0 objects fresher, 0 objects ignored
2006/11/05 22:28:32| Completed Validation Procedure
2006/11/05 22:28:32| Validated 28933 Entries
2006/11/05 22:28:32| store_swap_size = 245232k
2006/11/05 22:28:33| storeLateRelease: released 23 objects

So, I must end by saying a big THANK YOU for your help in unravelling
this.

For Thomas-Martin Seck (the ports maintainer), yes, I believe you should
put something in the notes.
I prefer to compile my kernel with the "options VFS_AIO" than load the
module as I am not quite likely to forget about stuff I put into the
kernel.

-Wash

http://www.netmeister.org/news/learn2quote.html

DISCLAIMER: See http://www.wananchi.com/bms/terms.php

--
+======================================================================+
    |\      _,,,---,,_     | Odhiambo Washington    <wash@wananchi.com>
Zzz /,`.-'`'    -.  ;-;;,_ | Wananchi Online Ltd.   www.wananchi.com
   |,4-  ) )-,_. ,\ (  `'-'| Tel: +254 20 313985-9  +254 20 313922
  '---''(_/--'  `-'\_)     | GSM: +254 722 743223   +254 733 744121
+======================================================================+
"We'll cross out that bridge when we come back to it later."