[squid-users] Fatal error

From: Andres Biscione <[email protected]>
Date: Sun, 16 Dec 2001 22:55:12 -0300

Hello-

We've been running Squid for a month, approximately, and we recently had
some unprecedented problems. We don't find their cause, so maybe someone can
help.

Below is the cache.log relevant part, from the first error and on. We
suppose the first error to be the relevant one, and the other being caused
by it, but we're not sure.

Any enlightening will be enormously appreciated.

Thanks in advance,

Andres Biscione

---------------------------------------------------------

2001/12/15 09:26:49| clientKeepaliveNextRequest: FD 774 Sending next
2001/12/15 09:26:52| clientSendMoreData: Deferring
http://forum.inmatrix.com/ikonboard/images/pips1.gif
2001/12/15 09:26:52| clientKeepaliveNextRequest: FD 455 Sending next
2001/12/15 09:26:52| clientKeepaliveNextRequest: FD 609 Sending next
2001/12/15 09:26:52| clientKeepaliveNextRequest: FD 455 Sending next
2001/12/15 09:26:53| clientKeepaliveNextRequest: FD 609 Sending next
2001/12/15 09:26:53| clientKeepaliveNextRequest: FD 791 Sending next
2001/12/15 09:26:55| clientKeepaliveNextRequest: FD 791 Sending next
2001/12/15 09:28:07| parseHttpRequest: Unsupported method 'g/>
'
2001/12/15 09:28:07| clientReadRequest: FD 92 Invalid Request
2001/12/15 09:28:13| parseHttpRequest: Unsupported method 'items/>
'
2001/12/15 09:28:13| clientReadRequest: FD 752 Invalid Request
2001/12/15 09:28:22| diskHandleWrite: FD 2: disk write error: (27) File too
large
2001/12/15 09:28:22| storeDirWriteCleanLogs: Starting...
2001/12/15 09:28:22| WARNING: Closing open FD 17
2001/12/15 09:28:22| Finished. Wrote 16357 entries.
2001/12/15 09:28:22| Took 0.0 seconds (922196.5 entries/sec).
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.3.STABLE4): Terminated abnormally.
CPU Usage: 238375.230 seconds = 58180.200 user + 180195.030 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 399525
Memory usage for squid via mallinfo():
        total space in arena: 21445 KB
        Ordinary blocks: 19275 KB 2707 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 176 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 2170 KB
        Total in use: 19451 KB 91%
        Total free: 2170 KB 10%
2001/12/15 09:28:25| Starting Squid Cache version 2.3.STABLE4 for
i386-redhat-linux-gnu...
2001/12/15 09:28:25| Process ID 31373
2001/12/15 09:28:25| With 1024 file descriptors available
2001/12/15 09:28:25| DNS Socket created on FD 1
2001/12/15 09:28:25| Adding nameserver 200.61.33.2 from /etc/resolv.conf
2001/12/15 09:28:25| Adding nameserver 200.61.33.3 from /etc/resolv.conf
2001/12/15 09:28:25| helperOpenServers: Starting 10 'leer.pl.back' processes
2001/12/15 09:28:25| Unlinkd pipe opened on FD 16
2001/12/15 09:28:25| Swap maxSize 102400 KB, estimated 7876 objects
2001/12/15 09:28:25| Target number of buckets: 157
2001/12/15 09:28:25| Using 8192 Store buckets
2001/12/15 09:28:25| Max Mem size: 8192 KB
2001/12/15 09:28:25| Max Swap size: 102400 KB
2001/12/15 09:28:25| Store logging disabled
2001/12/15 09:28:25| Using LFUDA disk replacement policy
2001/12/15 09:28:25| Rebuilding storage in /usr/local/squid-cache (CLEAN)
2001/12/15 09:28:25| Set Current Directory to /usr/local/squid-cache
2001/12/15 09:28:25| Loaded Icons.
2001/12/15 09:28:26| Accepting HTTP connections at 0.0.0.0, port 8080, FD
17.
2001/12/15 09:28:26| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2001/12/15 09:28:26| Accepting SNMP messages on port 3401, FD 19.
2001/12/15 09:28:26| WCCP Disabled.
2001/12/15 09:28:26| Ready to serve requests.
2001/12/15 09:28:26| Done reading /usr/local/squid-cache swaplog (16357
entries)
2001/12/15 09:28:26| Finished rebuilding storage from disk.
2001/12/15 09:28:26| 16357 Entries scanned
2001/12/15 09:28:26| 0 Invalid entries.
2001/12/15 09:28:26| 0 With invalid flags.
2001/12/15 09:28:26| 16357 Objects loaded.
2001/12/15 09:28:26| 0 Objects expired.
2001/12/15 09:28:26| 0 Objects cancelled.
2001/12/15 09:28:26| 0 Duplicate URLs purged.
2001/12/15 09:28:26| 0 Swapfile clashes avoided.
2001/12/15 09:28:26| Took 1.0 seconds (16570.6 objects/sec).
2001/12/15 09:28:26| Beginning Validation Procedure
2001/12/15 09:28:26| Completed Validation Procedure
2001/12/15 09:28:26| Validated 16357 Entries
2001/12/15 09:28:26| store_swap_size = 77600k
2001/12/15 09:28:26| storeLateRelease: released 0 objects
2001/12/15 09:28:27| diskHandleWrite: FD 2: disk write error: (27) File too
large
2001/12/15 09:28:27| storeDirWriteCleanLogs: Starting...
2001/12/15 09:28:27| WARNING: Closing open FD 17
2001/12/15 09:28:27| Finished. Wrote 16357 entries.
2001/12/15 09:28:27| Took 0.0 seconds (1128458.1 entries/sec).
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.3.STABLE4): Terminated abnormally.
CPU Usage: 0.190 seconds = 0.120 user + 0.070 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 598
Memory usage for squid via mallinfo():
        total space in arena: 4105 KB
        Ordinary blocks: 4081 KB 3 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 176 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 24 KB
        Total in use: 4257 KB 104%
        Total free: 24 KB 1%
2001/12/15 09:28:30| Starting Squid Cache version 2.3.STABLE4 for
i386-redhat-linux-gnu...
2001/12/15 09:28:30| Process ID 31385
2001/12/15 09:28:30| With 1024 file descriptors available
2001/12/15 09:28:30| DNS Socket created on FD 1
2001/12/15 09:28:30| Adding nameserver 200.61.33.2 from /etc/resolv.conf
2001/12/15 09:28:30| Adding nameserver 200.61.33.3 from /etc/resolv.conf
2001/12/15 09:28:30| helperOpenServers: Starting 10 'leer.pl.back' processes
2001/12/15 09:28:30| Unlinkd pipe opened on FD 16
2001/12/15 09:28:30| Swap maxSize 102400 KB, estimated 7876 objects
2001/12/15 09:28:30| Target number of buckets: 157
2001/12/15 09:28:30| Using 8192 Store buckets
2001/12/15 09:28:30| Max Mem size: 8192 KB
2001/12/15 09:28:30| Max Swap size: 102400 KB
2001/12/15 09:28:30| Store logging disabled
2001/12/15 09:28:30| Using LFUDA disk replacement policy
2001/12/15 09:28:30| Rebuilding storage in /usr/local/squid-cache (CLEAN)
2001/12/15 09:28:30| Set Current Directory to /usr/local/squid-cache
2001/12/15 09:28:30| Loaded Icons.
2001/12/15 09:28:30| Accepting HTTP connections at 0.0.0.0, port 8080, FD
17.
2001/12/15 09:28:30| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2001/12/15 09:28:30| Accepting SNMP messages on port 3401, FD 19.
2001/12/15 09:28:30| WCCP Disabled.
2001/12/15 09:28:30| Ready to serve requests.
2001/12/15 09:28:31| Done reading /usr/local/squid-cache swaplog (16357
entries)
2001/12/15 09:28:31| Finished rebuilding storage from disk.
2001/12/15 09:28:31| 16357 Entries scanned
2001/12/15 09:28:31| 0 Invalid entries.
2001/12/15 09:28:31| 0 With invalid flags.
2001/12/15 09:28:31| 16357 Objects loaded.
2001/12/15 09:28:31| 0 Objects expired.
2001/12/15 09:28:31| 0 Objects cancelled.
2001/12/15 09:28:31| 0 Duplicate URLs purged.
2001/12/15 09:28:31| 0 Swapfile clashes avoided.
2001/12/15 09:28:31| Took 0.6 seconds (29709.9 objects/sec).
2001/12/15 09:28:31| Beginning Validation Procedure
2001/12/15 09:28:31| Completed Validation Procedure
2001/12/15 09:28:31| Validated 16357 Entries
2001/12/15 09:28:31| store_swap_size = 77600k
2001/12/15 09:28:31| storeLateRelease: released 0 objects
2001/12/15 09:28:31| diskHandleWrite: FD 2: disk write error: (27) File too
large
2001/12/15 09:28:31| storeDirWriteCleanLogs: Starting...
2001/12/15 09:28:31| WARNING: Closing open FD 17
2001/12/15 09:28:31| Finished. Wrote 16357 entries.
2001/12/15 09:28:31| Took 0.0 seconds (1148827.1 entries/sec).
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.3.STABLE4): Terminated abnormally.
CPU Usage: 0.160 seconds = 0.130 user + 0.030 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 527
Memory usage for squid via mallinfo():
        total space in arena: 4117 KB
        Ordinary blocks: 4095 KB 3 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 176 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 22 KB
        Total in use: 4271 KB 104%
        Total free: 22 KB 1%
2001/12/15 09:28:34| Starting Squid Cache version 2.3.STABLE4 for
i386-redhat-linux-gnu...
2001/12/15 09:28:34| Process ID 31397
2001/12/15 09:28:34| With 1024 file descriptors available
2001/12/15 09:28:34| DNS Socket created on FD 1
2001/12/15 09:28:34| Adding nameserver 200.61.33.2 from /etc/resolv.conf
2001/12/15 09:28:34| Adding nameserver 200.61.33.3 from /etc/resolv.conf
2001/12/15 09:28:34| helperOpenServers: Starting 10 'leer.pl.back' processes
2001/12/15 09:28:34| Unlinkd pipe opened on FD 16
2001/12/15 09:28:34| Swap maxSize 102400 KB, estimated 7876 objects
2001/12/15 09:28:34| Target number of buckets: 157
2001/12/15 09:28:34| Using 8192 Store buckets
2001/12/15 09:28:34| Max Mem size: 8192 KB
2001/12/15 09:28:34| Max Swap size: 102400 KB
2001/12/15 09:28:34| Store logging disabled
2001/12/15 09:28:34| Using LFUDA disk replacement policy
2001/12/15 09:28:34| Rebuilding storage in /usr/local/squid-cache (CLEAN)
2001/12/15 09:28:34| Set Current Directory to /usr/local/squid-cache
2001/12/15 09:28:34| Loaded Icons.
2001/12/15 09:28:35| Accepting HTTP connections at 0.0.0.0, port 8080, FD
17.
2001/12/15 09:28:35| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2001/12/15 09:28:35| Accepting SNMP messages on port 3401, FD 19.
2001/12/15 09:28:35| WCCP Disabled.
2001/12/15 09:28:35| Ready to serve requests.
2001/12/15 09:28:35| Done reading /usr/local/squid-cache swaplog (16357
entries)
2001/12/15 09:28:35| Finished rebuilding storage from disk.
2001/12/15 09:28:35| 16357 Entries scanned
2001/12/15 09:28:35| 0 Invalid entries.
2001/12/15 09:28:35| 0 With invalid flags.
2001/12/15 09:28:35| 16357 Objects loaded.
2001/12/15 09:28:35| 0 Objects expired.
2001/12/15 09:28:35| 0 Objects cancelled.
2001/12/15 09:28:35| 0 Duplicate URLs purged.
2001/12/15 09:28:35| 0 Swapfile clashes avoided.
2001/12/15 09:28:35| Took 0.5 seconds (31554.2 objects/sec).
2001/12/15 09:28:35| Beginning Validation Procedure
2001/12/15 09:28:35| Completed Validation Procedure
2001/12/15 09:28:35| Validated 16357 Entries
2001/12/15 09:28:35| store_swap_size = 77600k
2001/12/15 09:28:35| diskHandleWrite: FD 2: disk write error: (27) File too
large
2001/12/15 09:28:35| storeDirWriteCleanLogs: Starting...
2001/12/15 09:28:35| WARNING: Closing open FD 17
2001/12/15 09:28:35| Finished. Wrote 16357 entries.
2001/12/15 09:28:35| Took 0.0 seconds (1151414.9 entries/sec).
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.3.STABLE4): Terminated abnormally.
CPU Usage: 0.170 seconds = 0.130 user + 0.040 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 525
Memory usage for squid via mallinfo():
        total space in arena: 4097 KB
        Ordinary blocks: 4076 KB 4 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 176 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 21 KB
        Total in use: 4252 KB 104%
        Total free: 21 KB 1%
2001/12/15 09:28:38| Starting Squid Cache version 2.3.STABLE4 for
i386-redhat-linux-gnu...
2001/12/15 09:28:38| Process ID 31409
2001/12/15 09:28:38| With 1024 file descriptors available
2001/12/15 09:28:38| DNS Socket created on FD 1
2001/12/15 09:28:38| Adding nameserver 200.61.33.2 from /etc/resolv.conf
2001/12/15 09:28:38| Adding nameserver 200.61.33.3 from /etc/resolv.conf
2001/12/15 09:28:38| helperOpenServers: Starting 10 'leer.pl.back' processes
2001/12/15 09:28:39| Unlinkd pipe opened on FD 16
2001/12/15 09:28:39| Swap maxSize 102400 KB, estimated 7876 objects
2001/12/15 09:28:39| Target number of buckets: 157
2001/12/15 09:28:39| Using 8192 Store buckets
2001/12/15 09:28:39| Max Mem size: 8192 KB
2001/12/15 09:28:39| Max Swap size: 102400 KB
2001/12/15 09:28:39| Store logging disabled
2001/12/15 09:28:39| Using LFUDA disk replacement policy
2001/12/15 09:28:39| Rebuilding storage in /usr/local/squid-cache (CLEAN)
2001/12/15 09:28:39| Set Current Directory to /usr/local/squid-cache
2001/12/15 09:28:39| Loaded Icons.
2001/12/15 09:28:39| Accepting HTTP connections at 0.0.0.0, port 8080, FD
17.
2001/12/15 09:28:39| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2001/12/15 09:28:39| Accepting SNMP messages on port 3401, FD 19.
2001/12/15 09:28:39| WCCP Disabled.
2001/12/15 09:28:39| Ready to serve requests.
2001/12/15 09:28:39| Done reading /usr/local/squid-cache swaplog (16357
entries)
2001/12/15 09:28:39| Finished rebuilding storage from disk.
2001/12/15 09:28:39| 16357 Entries scanned
2001/12/15 09:28:39| 0 Invalid entries.
2001/12/15 09:28:39| 0 With invalid flags.
2001/12/15 09:28:39| 16357 Objects loaded.
2001/12/15 09:28:39| 0 Objects expired.
2001/12/15 09:28:39| 0 Objects cancelled.
2001/12/15 09:28:39| 0 Duplicate URLs purged.
2001/12/15 09:28:39| 0 Swapfile clashes avoided.
2001/12/15 09:28:39| Took 0.6 seconds (28052.6 objects/sec).
2001/12/15 09:28:39| Beginning Validation Procedure
2001/12/15 09:28:39| Completed Validation Procedure
2001/12/15 09:28:39| Validated 16357 Entries
2001/12/15 09:28:39| store_swap_size = 77600k
2001/12/15 09:28:40| storeLateRelease: released 0 objects
2001/12/15 09:28:40| diskHandleWrite: FD 2: disk write error: (27) File too
large
2001/12/15 09:28:40| storeDirWriteCleanLogs: Starting...
2001/12/15 09:28:40| WARNING: Closing open FD 17
2001/12/15 09:28:40| Finished. Wrote 16357 entries.
2001/12/15 09:28:40| Took 0.0 seconds (1160317.8 entries/sec).
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.3.STABLE4): Terminated abnormally.
CPU Usage: 0.160 seconds = 0.110 user + 0.050 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 527
Memory usage for squid via mallinfo():
        total space in arena: 4177 KB
        Ordinary blocks: 4156 KB 4 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 176 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 21 KB
        Total in use: 4332 KB 104%
        Total free: 21 KB 1%
2001/12/15 09:28:43| Starting Squid Cache version 2.3.STABLE4 for
i386-redhat-linux-gnu...
2001/12/15 09:28:43| Process ID 31421
2001/12/15 09:28:43| With 1024 file descriptors available
2001/12/15 09:28:43| DNS Socket created on FD 1
2001/12/15 09:28:43| Adding nameserver 200.61.33.2 from /etc/resolv.conf
2001/12/15 09:28:43| Adding nameserver 200.61.33.3 from /etc/resolv.conf
2001/12/15 09:28:43| helperOpenServers: Starting 10 'leer.pl.back' processes
2001/12/15 09:28:43| Unlinkd pipe opened on FD 16
2001/12/15 09:28:43| Swap maxSize 102400 KB, estimated 7876 objects
2001/12/15 09:28:43| Target number of buckets: 157
2001/12/15 09:28:43| Using 8192 Store buckets
2001/12/15 09:28:43| Max Mem size: 8192 KB
2001/12/15 09:28:43| Max Swap size: 102400 KB
2001/12/15 09:28:43| Store logging disabled
2001/12/15 09:28:43| Using LFUDA disk replacement policy
2001/12/15 09:28:43| Rebuilding storage in /usr/local/squid-cache (CLEAN)
2001/12/15 09:28:43| Set Current Directory to /usr/local/squid-cache
2001/12/15 09:28:43| Loaded Icons.
2001/12/15 09:28:44| Accepting HTTP connections at 0.0.0.0, port 8080, FD
17.
2001/12/15 09:28:44| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2001/12/15 09:28:44| Accepting SNMP messages on port 3401, FD 19.
2001/12/15 09:28:44| WCCP Disabled.
2001/12/15 09:28:44| Ready to serve requests.
2001/12/15 09:28:44| Done reading /usr/local/squid-cache swaplog (16357
entries)
2001/12/15 09:28:44| Finished rebuilding storage from disk.
2001/12/15 09:28:44| 16357 Entries scanned
2001/12/15 09:28:44| 0 Invalid entries.
2001/12/15 09:28:44| 0 With invalid flags.
2001/12/15 09:28:44| 16357 Objects loaded.
2001/12/15 09:28:44| 0 Objects expired.
2001/12/15 09:28:44| 0 Objects cancelled.
2001/12/15 09:28:44| 0 Duplicate URLs purged.
2001/12/15 09:28:44| 0 Swapfile clashes avoided.
2001/12/15 09:28:44| Took 0.6 seconds (28957.8 objects/sec).
2001/12/15 09:28:44| Beginning Validation Procedure
2001/12/15 09:28:44| Completed Validation Procedure
2001/12/15 09:28:44| Validated 16357 Entries
2001/12/15 09:28:44| store_swap_size = 77600k
2001/12/15 09:28:44| diskHandleWrite: FD 2: disk write error: (27) File too
large
2001/12/15 09:28:44| storeDirWriteCleanLogs: Starting...
2001/12/15 09:28:44| WARNING: Closing open FD 17
2001/12/15 09:28:44| Finished. Wrote 16357 entries.
2001/12/15 09:28:44| Took 0.0 seconds (1145047.3 entries/sec).
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.3.STABLE4): Terminated abnormally.
CPU Usage: 0.180 seconds = 0.120 user + 0.060 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 526
Memory usage for squid via mallinfo():
        total space in arena: 4113 KB
        Ordinary blocks: 4091 KB 7 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 176 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 21 KB
        Total in use: 4267 KB 104%
        Total free: 21 KB 1%
[root@bilbo squid]#
Received on Sun Dec 16 2001 - 19:00:04 MST

This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 17:05:22 MST