Re: [squid-users] Squid on steroids

50,000 customers total.

We're looking at LVS using keepalived for load balancing at the front-end.

I'm most interested in the squid back-end setup. Should we look at something linux based clustering? Or should we be looking at some internal squid process?

Could we run multiple squid processes on multi-processor servers? Is that wise? Or should we look at more servers rather than multiple squid processes on one server?

How much memory for each server? I've seen some talk here about oprofile. We plan on checking that out to see where things are. I have no problem in setting up a test environment and reporting the results back here. I'd just like to start out on the right track.

I do believe in giving back to the community with information we'll learn through this process.

Thank you for your comments and thoughts thus far.

 -------------- Original message ----------------------
From: Mark Nottingham <mnot_at_yahoo-inc.com>
> If you're not caching at all and using reasonably modern hardware
> (e.g., dual core, ~3Ghz), you should be able to get somewhere between
> 2,000 and 4,000 requests a second out of a single squid process,
> depending on the average response size. YMMV, of course, and that
> doesn't count the overhead of the filtering, etc.
>
> By 50,000 users, do you mean total (i.e., you have 50,000 customers),
> or 50,000 a day, or 50,000 concurrently, or...? Figuring out how much
> capacity you need is an inexact science, of course, but it's usually
> best to over-provision.
>
> The hard part is going to be directing requests to the proxies, and
> handling failure well. I haven't done ISP proxy deployments in a long
> time, so I'll leave it to others to give you advice on that part. I'm
> assuming you'll want it to be transparent (e.g., use WCCP)?
>
>
>
>
> On 18/06/2008, at 9:05 AM, ffredrixson_at_comcast.net wrote:
>
> > More broadband connections than anything else.
> >
> > Possibly as many as 50,000 users.
> >
> > No accelerator, maybe not even caching. Mostly to filter downloads,
> > record websites, etc. maybe with something like urldb or Dansguardian.
> >
> > Do you have ideas???
> >
> > Thank you.
> >
> >
> > -------------- Original message ----------------------
> > From: Mark Nottingham <mnot_at_yahoo-inc.com>
> >> What's your workload? E.g., is it going to be used as a proxy farm
> >> for
> >> dialup users? Broadband? If so, how many? Or, is it for an
> >> accelerator, and if so, how much content is there?
> >>
> >> Cheers,
> >>
> >>
> >> On 18/06/2008, at 5:07 AM, ffredrixson_at_comcast.net wrote:
> >>
> >>> I've been given a directive to build a squid farm on steroids.
> >>>
> >>> Load balanced, multiple servers, etc.
> >>>
> >>> I've been googling around and found some documentation but does
> >>> anyone have any direct experience with this?
> >>>
> >>> Any suggestions?
> >>>
> >>> Thank you in advance.
> >>
> >> --
> >> Mark Nottingham mnot_at_yahoo-inc.com
> >>
> >>
> >
> > More broadband connections than anything else.
> >
> > Possibly as many as 50,000 users.
> >
> > No accelerator, maybe not even caching. Mostly to filter downloads,
> > record websites, etc. maybe with something like urldb or Dansguardian.
> >
> > Do you have ideas???
> >
> > Thank you.
> >
> >
>
> --
> Mark Nottingham mnot_at_yahoo-inc.com
>
>
Received on Wed Jun 18 2008 - 01:45:05 MDT