Re: Performance issues with compaq server

From: Holger Marzen <holger(at)marzen(dot)de>
To: Martijn van Oosterhout <kleptog(at)svana(dot)org>
Cc: "Samuel J(dot) Sutjiono" <ssutjiono(at)wc-group(dot)com>, <pgsql-general(at)postgresql(dot)org>, <pgsql-sql(at)postgresql(dot)org>
Subject: Re: Performance issues with compaq server
Date: 2002-05-08 07:05:50
Message-ID: Pine.LNX.4.44.0205080903080.11632-100000@bluebell.marzen.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-sql

On Wed, 8 May 2002, Martijn van Oosterhout wrote:

> On Tue, May 07, 2002 at 06:40:32PM -0400, Samuel J. Sutjiono wrote:
>
> > I tried to load data using insert statement to our new database server
> > (Compaq DL580, DL590, DL380 using SCSI driver) but it was very very slow.
> > The database runs on Red Hat Linux 7.2 and PostgreSQL version 7.1.3
> >
> > Does anybody know any idea to what cause this problem ? or things that I
> > need to look or check (in the config. file)
>
> Put them in a trasaction (begin/commit). Without that, each insert becomes
> it's own transaction which is rather expensive. Postgresql 7.2 improves this
> a bit but the transaction will help anyway.

ACK. On a given hardware I get about 150 inserts per second. Using a
begin/end transaction for a group of 100 inserts speeds it up to about
450 inserts per second.

But beware: if one insert fails (duplicate key, faulty data) then you
have to re-insert the remaining rows as single transactions, else all
rows of the previous transaction are discarded.

--
PGP/GPG Key-ID:
http://blackhole.pca.dfn.de:11371/pks/lookup?op=get&search=0xB5A1AFE1

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Tille, Andreas 2002-05-08 07:30:03 PgAdmin2 trouble (Was: Allow user to create tables)
Previous Message Tom Lane 2002-05-08 05:26:10 Re: Logging function calls to figure out lo_close log entries?

Browse pgsql-sql by date

  From Date Subject
Next Message Doug McNaught 2002-05-08 15:02:35 Re: Performance issues with compaq server
Previous Message Rajesh Kumar Mallah. 2002-05-08 06:15:37 data loss due to improper handling of postmaster ....