Re: Fsync on/off For Various Filesystems/Platforms

From: Mark kirkwood <markir(at)slingshot(dot)co(dot)nz>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Fsync on/off For Various Filesystems/Platforms
Date: 2002-03-10 02:24:10
Message-ID: 1015727051.1388.39.camel@spikey.slithery.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

>(Quoting Tom Lane)
>Still not much help. Was it a single COPY command, or a bunch of them?
>

Err..clearly should not send messages in the evening :-(
One single process was doing the load - so there is 1 big copy , and 1
transaction.

>try something with one commit per inserted
>row if you want to see a bigger penalty ...

you are indeed right. We were (attempting) to determine the penalty for
loads via copy - rather than determining bounds for the fsync=on penalty
in a general case (but we didnt actually say that).

In hindsight the posting was poorly named - something like :
"The effect of fsync on/off for a single threaded copy" would have been
a much better name.

>Also, if there was only one transaction
>commit in your 5-minute benchmark run, then I can see why fsync would
>be pretty irrelevant ...

So I was expecting to see pretty much no effect for fsync on vs off.
Which is pretty much what we saw - except for ext3, where that single
5-min transaction got an extra 30s added to it for fsync=on

This is what I thought was interesting - I guess maybe the ext3
development lists may have been a better place do the post.

(Quoting Bruce Momjian)
>Also, someone reported ext3
>as 50% slower than ext2, so again, your numbers are a surprise.

I found myself thinking "what mount options and journal sizes option did
they use?", which prompted me to include the ones I used (data=ordered &
100M journal ) - another small oversight :-(.
If I use data=journal + a small (say 20M) journal then I am sure I can
approach your 50%...

Regards and apologies for the several confusions

Mark

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Michael 2002-03-10 03:33:05 postgres 7.2 make check problem
Previous Message Francisco Reyes 2002-03-10 00:25:49 spanish characters in postgresql