Re: INSERT extremely slow with large data sets (fwd)

From: Jeff <threshar(at)torgo(dot)978(dot)org>
To: Slavisa Garic <Slavisa(dot)Garic(at)infotech(dot)monash(dot)edu(dot)au>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: INSERT extremely slow with large data sets (fwd)
Date: 2003-11-14 13:37:55
Message-ID: 20031114083755.67841110.threshar@torgo.978.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Fri, 14 Nov 2003 20:38:33 +1100 (EST)
Slavisa Garic <Slavisa(dot)Garic(at)infotech(dot)monash(dot)edu(dot)au> wrote:

> Any help would be greatly appreciated even pointing me in the right
> direction where to ask this question. By the way I designed the
> database this way as my application that uses PGSQL a lot during the
> execution so there was a huge need for fast SELECTs. Our experiments
> are getting larger and larger every day so fast inserts would be good
> as well.
>

First, you need to upgrade to 7.3.4, 7.4 is prefable if a dump/reload is
not too bad.

Standard set of questions:

1. Any foreign keys
2. are these inserts batched into transactions
3. CPU usage?
4. OS?
5. PG config? [shared_buffers, effective_cache_size, etc]
6. IO saturation?

Also, try searching the archives. lots of juicy info there too.

--
Jeff Trout <jeff(at)jefftrout(dot)com>
http://www.jefftrout.com/
http://www.stuarthamm.net/

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Christopher Browne 2003-11-14 14:13:48 Re: Help with count(*)
Previous Message Nick Barr 2003-11-14 10:11:44 IDE Hardware RAID Controller