Re: [HACKERS] Performance while loading data and indexing

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Justin Clift <justin(at)postgresql(dot)org>
Cc: shridhar_daithankar(at)persistent(dot)co(dot)in, pgsql-hackers(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 14:42:08
Message-ID: 4031.1033051328@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

Justin Clift <justin(at)postgresql(dot)org> writes:
>> On 26 Sep 2002 at 19:05, Martijn van Oosterhout wrote:
>>> fsync IIRC only affects the WAL buffers now but it may be quite expensive,
>>> especially considering it's running on every transaction commit. Oh, your
>>> WAL files are on a seperate disk from the data?

> Not sure if this is a good idea. Would have to think deeply about the
> controller and drive optimisation/load characteristics.

> If it's any help, when I was testing recently with WAL on a separate
> drive, the WAL logs were doing more read&writes per second than the main
> data drive.

... but way fewer seeks. For anything involving lots of updating
transactions (and certainly 5000 separate insertions per second would
qualify; can those be batched??), it should be a win to put WAL on its
own spindle, just to get locality of access to the WAL.

regards, tom lane

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2002-09-26 14:46:18 Re: Adding "on delete cascade" after table creation ?
Previous Message Johnson, Shaunn 2002-09-26 14:40:33 get date in binary number format

Browse pgsql-hackers by date

  From Date Subject
Next Message Shridhar Daithankar 2002-09-26 14:52:05 Re: Performance while loading data and indexing
Previous Message Tom Lane 2002-09-26 14:37:35 Re: Performance while loading data and indexing

Browse pgsql-performance by date

  From Date Subject
Next Message Shridhar Daithankar 2002-09-26 14:52:05 Re: Performance while loading data and indexing
Previous Message Tom Lane 2002-09-26 14:33:58 Re: Performance while loading data and indexing