Re: insert performance riddle

From: Steve Wormley <steve(at)wormley(dot)com>
To: "Ed L(dot)" <pgsql(at)bluepolka(dot)net>
Cc: <pgsql-general(at)postgresql(dot)org>
Subject: Re: insert performance riddle
Date: 2005-08-11 22:06:35
Message-ID: BF2119FB.18E88%steve@wormley.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general


>
> Michael, you nailed it again. My libpq test C program delivered
> between 2400 QPS and 5000 QPS vs ~10 QPS for DBI/DBD::Pg on this
> box.
>
> It remains unclear to me why the same DBI/DBD::Pg client code
> would deliver performance 2-3 orders of magnitude better on
> other roughly comparable or inferior boxes.
>

I'm using DBD::Pg for some large inserts(well, they were large) most of it
was pretty reasonable, there were some quirky things, like last_insert_id
is/was incredibly slow(it's very smart, but the way it does things makes the
performance horrible) doing the currval call yourself is much faster.
I found that using the Perl profiler identified a couple things like that
and let me get things to a reasonable speed.

-Steve

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2005-08-11 22:09:41 Re: Upgrading 7.3.9 -> 7.4.8 - trouble with blobs
Previous Message Christian Goetze 2005-08-11 21:59:17 Re: Upgrading 7.3.9 -> 7.4.8 - trouble with blobs