Re: WAL Performance Improvements

From: Helge Bahmann <bahmann(at)math(dot)tu-freiberg(dot)de>
To: Janardhana Reddy <jana-reddy(at)mediaring(dot)com(dot)sg>
Cc: pgsql-patches <pgsql-patches(at)postgresql(dot)org>
Subject: Re: WAL Performance Improvements
Date: 2002-02-26 13:34:10
Message-ID: Pine.LNX.4.21.0202261350400.10860-100000@lothlorien.stunet2.tu-freiberg.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-patches

On Tue, 26 Feb 2002, Janardhana Reddy wrote:
> SUMMARY :
>
> Test1: (data_size= 8192 , with test program)
> fdatasync time +write time: 3141+46 = 3187 usec/call
> Time taken for 10000 iterations: nearly 40 seconds
> Test2 : (data_size = 160, with test program)
> fdatasync time+write time: 396 +13 = 409 usec/call
> Time taken for 10000 iterations: nealy 4 seconds

This only shows that your harddisk is doing write caching, although it
claims it does not (And on such systems I am tempted to say you can
turn off fsync unconditionally as it will gain you almost nothing).

Please look at the numbers: It is really *impossible* for any harddisk to
write to the same location more than 2000 times per second - simply due to
the fact that the disks are not rotating that fast. The fact that turning
writing caching on or off does not make a difference should make you
suspicious.

(In fact looking more closely at the numbers I am tempted to bet that you
operate your IDE disk in PIO mode: 1024bytes/400usec= 8192bytes/3200usec=
2.5MByte/s, and all you are benchmarking is the PIO transfer rate of your
IDE-controller/CPU combination).

This is not to say that your WAL optimization is worthless, but the
benchmark you gave is certainly wrong.

Regards
--
Helge Bahmann <bahmann(at)math(dot)tu-freiberg(dot)de> /| \__
Network admin, systems programmer /_|____\
_/\ | __)
$ ./configure \\ \|__/__|
checking whether build environment is sane... yes \\/___/ |
checking for AIX... no (we already did this) |

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Art Nicewick 2002-02-26 14:09:47 Re: PostgreSQL 8.0 ??
Previous Message Brian Moran 2002-02-26 13:17:53 Re: setting up a trace through extended stored procedures

Browse pgsql-patches by date

  From Date Subject
Next Message Bruce Momjian 2002-02-26 15:46:02 Re: minor doc patch for example in 'SET' docs
Previous Message Thomas Lockhart 2002-02-26 13:27:09 Re: minor doc patch for example in 'SET' docs