Re: indexes greatly slowing data entry

From: nconway(at)klamath(dot)dyndns(dot)org (Neil Conway)
To: Eric <emayo(at)pozicom(dot)net>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: indexes greatly slowing data entry
Date: 2002-06-26 14:25:16
Message-ID: 20020626142516.GA15972@klamath.dyndns.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Tue, Jun 25, 2002 at 04:16:05PM -0400, Eric wrote:
> We are importing anywhere from 10,000 - 100,000 records each day and after
> this import, performance takes a major nose dive on us.
>
> And, because this data gets imported during normal business hours we can not
> tie up the server with a vacuum. I understand 7.2 has a better vacuum but
> this doesn't seem to solve our problem because we need to be able to use the
> database during the 30 minutes it takes to import the data.

30 minutes for 100,000 records seems really high. How are you
importing the data? Are you using COPY? If you're using INSERTs,
are you putting multiple INSERTs inside a single transaction?

> There are approximately 25 users on the database at any given time. Problem
> seems slightly amplified when users logged goes from 1 to 25.

Upgrading to 7.2 would help the VACUUM performance, at any rate.

Cheers,

Neil

--
Neil Conway <neilconway(at)rogers(dot)com>
PGP Key ID: DB3C29FC

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Jan Wieck 2002-06-26 14:44:57 (A) native Windows port
Previous Message Johnson, Shaunn 2002-06-26 14:01:12 How to run multi-processor question