Re: newbie design question re impact of VACUUM

From: Harald Fuchs <hf0923x(at)protecting(dot)net>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: newbie design question re impact of VACUUM
Date: 2005-11-09 16:14:35
Message-ID: 87ek5pztlg.fsf@srv.protecting.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

In article <1131466149(dot)590544(dot)159870(at)g43g2000cwa(dot)googlegroups(dot)com>,
"shakahshakah(at)gmail(dot)com" <shakahshakah(at)gmail(dot)com> writes:

> As a background, I'll be using Postgres in part as a processing queue
> for a 40-column stream of information (~ 250 bytes/row) with a
> sustained input rate of 20 rows/sec. This queue will be processed
> periodically (every few minutes), design constraints are to (1) only
> process each row once, and (2) keep the processed rows around for a
> period of time (say a month or so).

> My first (naive?) idea was to add a boolean "was_processed" column to
> the table (defaulted to false) and UPDATE it to true as part of (1).
> After reading Chapter 22, though, it seems that even a minor UPDATE
> like that copies the row and requires VACUUMing.

That's true, but there might be a way to avoid it. If your queue
elements have a timestamp, you could run your processing routine not
over elements where "was_processed" is false, but over elements within
some time interval, e.g. the last minute. This would eliminate the
need for an UPDATE.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Tino Wildenhain 2005-11-09 16:22:26 Re: Beyond the 1600 columns limit on windows
Previous Message TJ O'Donnell 2005-11-09 16:13:56 Re: resetting superuser password