Re: getting Squid logfiles into a database

The client I'm doing this for feels that once a day stats are not 'up to
date' enough for them.

I don't think that the time taken to insert the individual records will be
a problem in this particular case. Sixty dialin users, Squid running on a
PII 350MHz and the authentication and accounting DB will be running on
another PII 350MHz over a pretty much dedicated network.

Gavin

On Tue, 12 Jan 1999, Ian Cooper wrote:

> On Tue, 12 Jan 1999 18:23:51 +1100 (EST), Gavin Cameron wrote:
>
> [snip]
> >It would be helpful, I think it would be, to be able to get your access
> >logs put into a database, and I think it could be done in much the same
> >way as authentication
>
> Is there a need to have the transactions available in the database
> immediately? If not you'd probably be better off syphoning them into
> a database at the end of each day using your database's variant of
> psql's "copy" command. This gets around the need to do a single
> INSERT operation for every cache transaction - something that could,
> on a busy cache, lead to the db insertions taking longer than the
> logging period.
>
>
> Ian
> --
> Senior Research Engineer
> Mirror Image Internet
>
Received on Tue Jan 12 1999 - 03:33:02 MST