Re: large inserts and fsync

From: Sam Mason <sam(at)samason(dot)me(dot)uk>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: large inserts and fsync
Date: 2008-09-05 15:10:47
Message-ID: 20080905151047.GY7271@frubble.xen.chris-lamb.co.uk
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Fri, Sep 05, 2008 at 09:16:41AM -0400, Aaron Burnett wrote:
> For an upcoming release there is a 16 million row insert that on our test
> cluster takes about 2.5 hours to complete with all indices dropped
> beforehand.
>
> If I turn off fsync, it completes in under 10 minutes.

Have you tried bundling all the INSERT statements into a single
transaction? If you haven't then PG will run each statement in its own
transaction and then commit each INSERT statement to disk separately,
incurring large overheads.

Sam

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Aaron Burnett 2008-09-05 15:19:13 Re: large inserts and fsync
Previous Message Filip Rembiałkowski 2008-09-05 15:04:00 Re: a performence question