Re: Experimental patch for inter-page delay in VACUUM

From: Jan Wieck <JanWieck(at)Yahoo(dot)com>
To: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Greg Stark <gsstark(at)mit(dot)edu>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: Experimental patch for inter-page delay in VACUUM
Date: 2003-11-10 19:24:48
Message-ID: 3FAFE600.9010105@Yahoo.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Bruce Momjian wrote:

> Jan Wieck wrote:
>> Bruce Momjian wrote:
>>
>> > Jan Wieck wrote:
>> >> Bruce Momjian wrote:
>> >>
>> >> > Now, O_SYNC is going to force every write to the disk. If we have a
>> >> > transaction that has to write lots of buffers (has to write them to
>> >> > reuse the shared buffer)
>> >>
>> >> So make the background writer/checkpointer keeping the LRU head clean. I
>> >> explained that 3 times now.
>> >
>> > If the background cleaner has to not just write() but write/fsync or
>> > write/O_SYNC, it isn't going to be able to clean them fast enough. It
>> > creates a bottleneck where we didn't have one before.
>> >
>> > We are trying to eliminate an I/O storm during checkpoint, but the
>> > solutions seem to be making the non-checkpoint times slower.
>> >
>>
>> It looks as if you're assuming that I am making the backends unable to
>> write on their own, so that they have to wait on the checkpointer. I
>> never said that.
>
> Maybe I missed it but are those backend now doing write or write/fsync?
> If the former, that is fine. If the later, it does seem slower than it
> used to be.

In my all_performance.v4.diff they do write and the checkpointer does
write+sync.

Jan

--
#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me. #
#================================================== JanWieck(at)Yahoo(dot)com #

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Josh Berkus 2003-11-10 19:26:12 Re: [HACKERS] Changes to Contributor List
Previous Message Michael Mauger 2003-11-10 19:23:41 Re: Proposal: psql force prompting on notty