Re: [HACKERS] Performance while loading data and indexing

From: Justin Clift <justin(at)postgresql(dot)org>
To: shridhar_daithankar(at)persistent(dot)co(dot)in
Cc: pgsql-hackers(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 09:56:34
Message-ID: 3D92D9D2.64CF55F7@postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

Shridhar Daithankar wrote:
>
> On 26 Sep 2002 at 19:05, Martijn van Oosterhout wrote:
<snip>
> > fsync IIRC only affects the WAL buffers now but it may be quite expensive,
> > especially considering it's running on every transaction commit. Oh, your
> > WAL files are on a seperate disk from the data?
>
> No. Same RAID 5 disks..

Not sure if this is a good idea. Would have to think deeply about the
controller and drive optimisation/load characteristics.

If it's any help, when I was testing recently with WAL on a separate
drive, the WAL logs were doing more read&writes per second than the main
data drive. This would of course be affected by the queries you are
running against the database. I was just running Tatsuo's TPC-B stuff,
and the OSDB AS3AP tests.

> I guess we forgot to monitor system parameters. Next on my list is running
> vmstat, top and tuning bdflush.

That'll just be the start of it for serious performance tuning and
learning how PostgreSQL works. :)

<snip>
> Thanks once again...
> Bye
> Shridhar

--
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
- Indira Gandhi

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Peter Alberer 2002-09-26 10:15:00 Re: Adding "on delete cascade" after table creation ?
Previous Message Patrick Welche 2002-09-26 09:55:09 Re: Relation 0 does not exist

Browse pgsql-hackers by date

  From Date Subject
Next Message Shridhar Daithankar 2002-09-26 09:58:01 Re: Performance while loading data and indexing
Previous Message Patrick Welche 2002-09-26 09:55:09 Re: Relation 0 does not exist

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2002-09-26 14:33:58 Re: Performance while loading data and indexing
Previous Message Justin Clift 2002-09-26 09:49:53 Re: [HACKERS] Performance while loading data and indexing