Re: increasingly slow insert/copy performance

From: Scott Marlowe <smarlowe(at)g2switchworks(dot)com>
To: Todd Underwood <todd(at)renesys(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: increasingly slow insert/copy performance
Date: 2005-04-18 21:11:37
Message-ID: 1113858697.20921.536.camel@state.g2switchworks.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Sun, 2005-04-17 at 09:17, Todd Underwood wrote:
> howdy,
>
> i'm by no means a postgres expert, so i'm probably making a dumb
> mistake, but this is v. troubling.
>
> we have a script that bulk-uploads about 45K rows. we do this via
> perl DBI using the COPY functionality.
>
> the problem is that we do this about once per 5 minutes and the time
> it takes to do the operation steadily increases (going from about 5s
> to over 5m over the course of 24 hrs). the table has one primary key
> (so hence one index), that we drop and recreate during the bulk load.

I'm guessing that either you aren't vacuuming enough, or your fsm
settings are too low.

What does vacuum verbose say? What are your fsm settings? Does 'vacuum
full <tablename>' fix the problem?

Do NOT TURN OFF FSYNC.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2005-04-18 21:11:48 Re: increasingly slow insert/copy performance
Previous Message Lorenzo Thurman 2005-04-18 21:09:22 pg_dump fails