RE: [squid-users] sometimes the users can�t visit any webpage

Hi, thanks for your interest

Well, today I had same problem, this is an extract to my cache.log. The
problem happened about 15:30hrs, and the user reported me about 16:00 hrs,
and I had to restart the "squid service".

Any Idea? What does it mean "httpReadReply Excess data from..."?

2009/09/02 06:32:19| storeDirWriteCleanLogs: Starting...
2009/09/02 06:32:19| 65536 entries written so far.
2009/09/02 06:32:19| 131072 entries written so far.
2009/09/02 06:32:19| Finished. Wrote 132412 entries.
2009/09/02 06:32:19| Took 0.0 seconds (4109238.7 entries/sec).
2009/09/02 06:32:19| logfileRotate: /var/log/squid/store.log
2009/09/02 06:32:19| logfileRotate (stdio): /var/log/squid/store.log
2009/09/02 06:32:19| logfileRotate: /var/log/squid/access.log
2009/09/02 06:32:19| logfileRotate (stdio): /var/log/squid/access.log
2009/09/02 06:32:19| logfileRotate: /var/log/squid/access1.log
2009/09/02 06:32:19| logfileRotate (stdio): /var/log/squid/access1.log
2009/09/02 15:32:49| httpReadReply: Excess data from "GET
http://www.paginasamarillas.com.pe/js/scriptTagHead.js.jsp"
2009/09/02 15:32:49| httpReadReply: Excess data from "GET
http://www.paginasamarillas.com.pe/js/scriptHome.js.jsp"
2009/09/02 15:32:49| httpReadReply: Excess data from "GET
http://www.paginasamarillas.com.pe/searchBarLocality.do?stateId=&cityId=&sub
urbId="
2009/09/02 15:59:54| Preparing for shutdown after 337998 requests
2009/09/02 15:59:54| Waiting 30 seconds for active connections to finish
2009/09/02 15:59:54| FD 11 Closing HTTP connection
2009/09/02 16:00:25| Shutting down...
2009/09/02 16:00:25| FD 12 Closing ICP connection
2009/09/02 16:00:25| WARNING: Closing client 172.20.100.1 connection due to
lifetime timeout
2009/09/02 16:00:25|
http://mail.google.com/mail/images/cleardot.gif?zx=g31q8sija2fo
2009/09/02 16:00:25| WARNING: Closing client 172.20.100.136 connection due
to lifetime timeout
2009/09/02 16:00:25| http://kh.google.com/geauth
2009/09/02 16:00:25| WARNING: Closing client 172.20.100.1 connection due to
lifetime timeout
2009/09/02 16:00:25|
http://toolbarqueries.clients.google.com/history/feeds/default/subscriptions
/browser
2009/09/02 16:00:25| WARNING: Closing client 172.20.100.1 connection due to
lifetime timeout
2009/09/02 16:00:25|
http://mail.google.com/mail/images/cleardot.gif?zx=8w46jyqzoqzz
2009/09/02 16:00:25| Closing unlinkd pipe on FD 14
2009/09/02 16:00:25| storeDirWriteCleanLogs: Starting...
2009/09/02 16:00:25| 65536 entries written so far.
2009/09/02 16:00:25| 131072 entries written so far.
2009/09/02 16:00:25| Finished. Wrote 131216 entries.
2009/09/02 16:00:25| Took 0.0 seconds (4147942.1 entries/sec).
CPU Usage: 287.160 seconds = 128.300 user + 158.860 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 3
Memory usage for squid via mallinfo():
        total space in arena: 296144 KB
        Ordinary blocks: 295038 KB 22411 blks
        Small blocks: 0 KB 6 blks
        Holding blocks: 280 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 1105 KB
        Total in use: 295318 KB 100%
        Total free: 1105 KB 0%
2009/09/02 16:00:25| logfileClose: closing log /var/log/squid/store.log
2009/09/02 16:00:25| logfileClose: closing log /var/log/squid/access.log
2009/09/02 16:00:25| logfileClose: closing log /var/log/squid/access1.log
2009/09/02 16:00:25| Squid Cache (Version 2.7.STABLE3): Exiting normally.
2009/09/02 16:00:26| Starting Squid Cache version 2.7.STABLE3 for
i386-debian-linux-gnu...
2009/09/02 16:00:26| Process ID 17213
2009/09/02 16:00:26| With 1024 file descriptors available
2009/09/02 16:00:26| Using epoll for the IO loop
2009/09/02 16:00:26| DNS Socket created at 0.0.0.0, port 38200, FD 6
2009/09/02 16:00:26| Adding domain sensormatic.com.pe from /etc/resolv.conf
2009/09/02 16:00:26| Adding domain sensormatic.com.pe from /etc/resolv.conf
2009/09/02 16:00:26| Adding nameserver 200.48.225.130 from /etc/resolv.conf
2009/09/02 16:00:26| Adding nameserver 200.48.225.146 from /etc/resolv.conf
2009/09/02 16:00:26| User-Agent logging is disabled.
2009/09/02 16:00:26| Referer logging is disabled.
2009/09/02 16:00:26| logfileOpen: opening log /var/log/squid/access.log
2009/09/02 16:00:26| logfileOpen: opening log /var/log/squid/access1.log
2009/09/02 16:00:26| Unlinkd pipe opened on FD 12
2009/09/02 16:00:26| Swap maxSize 4194304 KB, estimated 322638 objects
2009/09/02 16:00:26| Target number of buckets: 16131
2009/09/02 16:00:26| Using 16384 Store buckets
2009/09/02 16:00:26| Max Mem size: 262144 KB
2009/09/02 16:00:26| Max Swap size: 4194304 KB
2009/09/02 16:00:26| Local cache digest enabled; rebuild/rewrite every
3600/3600 sec
2009/09/02 16:00:26| logfileOpen: opening log /var/log/squid/store.log
2009/09/02 16:00:26| Rebuilding storage in /var/spool/squid (CLEAN)
2009/09/02 16:00:26| Using Least Load store dir selection
2009/09/02 16:00:26| Set Current Directory to /var/spool/squid
2009/09/02 16:00:26| Loaded Icons.
2009/09/02 16:00:27| Accepting transparently proxied HTTP connections at
172.20.100.1, port 3128, FD 14.
2009/09/02 16:00:27| Accepting ICP messages at 0.0.0.0, port 3130, FD 15.
2009/09/02 16:00:27| HTCP Disabled.
2009/09/02 16:00:27| WCCP Disabled.
2009/09/02 16:00:27| Ready to serve requests.
2009/09/02 16:00:27| Store rebuilding is 3.1% complete
2009/09/02 16:00:27| Done reading /var/spool/squid swaplog (131216 entries)
2009/09/02 16:00:27| Finished rebuilding storage from disk.
2009/09/02 16:00:27| 131216 Entries scanned
2009/09/02 16:00:27| 0 Invalid entries.
2009/09/02 16:00:27| 0 With invalid flags.
2009/09/02 16:00:27| 131216 Objects loaded.
2009/09/02 16:00:27| 0 Objects expired.
2009/09/02 16:00:27| 0 Objects cancelled.
2009/09/02 16:00:27| 0 Duplicate URLs purged.
2009/09/02 16:00:27| 0 Swapfile clashes avoided.
2009/09/02 16:00:27| Took 0.9 seconds (143313.7 objects/sec).
2009/09/02 16:00:27| Beginning Validation Procedure
2009/09/02 16:00:27| Completed Validation Procedure
2009/09/02 16:00:27| Validated 131216 Entries
2009/09/02 16:00:27| store_swap_size = 3774128k
2009/09/02 16:00:27| storeLateRelease: released 0 objects

-----Mensaje original-----
De: Jeff Pang [mailto:pangj_at_arcor.de]
Enviado el: Lunes, 31 de Agosto de 2009 08:44 p.m.
Para: squid-users
Asunto: Re: [squid-users] sometimes the users can�t visit any webpage

2009/9/1 Jesus Angeles <jangeles_at_confidesolutions.com.pe>:
> Hi all, I have a problem. Three weeks ago I installed Squid 2.7.STABLE3 +
> Dansguardian 2.10.1.1 in GNU/Linux Ubuntu Server 9.04. First week was ok,
> but the service was started to fail, sometimes (once or twice for day )
the
> users can�t visit any webpage, the web browser shows a blank page (delay
on
> load), in those moment I check:
> - � � � The squid service is running.
> - � � � The dansguardian is ok, because if the users try visit a
prohibited
> web, It shows the access denied page.
> - � � � The logfile �(access.log) is generating logs (I checked with tail
> -f).
> - � � � The memory and HD space is ok (I have configured 256 MB in
cache_mem
> and 4096 MB in cache_dir)
> Then, in those moments, I have to execute “/etc/init.d/squid reload” to
> solve the problem.
>

Have you checked cache.log for the special requests?
Only the info on cache.log (or with debug level) is valuable.

Jeff.
Received on Wed Sep 02 2009 - 21:34:13 MDT