RE: anonymize_headers

From: Glenn Chisholm <[email protected]>
Date: Tue, 31 Aug 1999 14:03:14 -0600 (MDT)

> Both of these can get you locked out of some sites, so you
> will have to balance this against the privacy improvement.
> (The main reason for checking User Agent tends to be to
> prevent crawling of the site, or at least crawling by
> badly behaved crawlers.)
>
>
Are there many sites which deny access if there is no X-Forwarded-For
header?

How do they tell the user agent header is fake? I could deliver the AIX
Netscape useragent string for all requests.

glenn
Received on Tue Aug 31 1999 - 14:12:37 MDT

This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 16:48:09 MST