Re: Experimental patch for inter-page delay in VACUUM

From: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
To: Jan Wieck <JanWieck(at)Yahoo(dot)com>
Cc: Zeugswetter Andreas SB SD <ZeugswetterA(at)spardat(dot)at>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Greg Stark <gsstark(at)mit(dot)edu>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: Experimental patch for inter-page delay in VACUUM
Date: 2003-11-10 19:05:37
Message-ID: 200311101905.hAAJ5bk24142@candle.pha.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Jan Wieck wrote:
> Zeugswetter Andreas SB SD wrote:
>
> >> > One problem with O_SYNC would be, that the OS does not group writes any
> >> > more. So the code would need to eighter do it's own sorting and grouping
> >> > (256k) or use aio, or you won't be able to get the maximum out of the disks.
> >>
> >> Or just run multiple writer processes, which I believe is Oracle's
> >> solution.
> >
> > That does not help, since for O_SYNC the OS'es (those I know) do not group those
> > writes together. Oracle allows more than one writer to busy more than one disk(subsystem) and circumvent other per process limitations (mainly on platforms without AIO).
>
> Yes, I think the best way would be to let the background process write a
> bunch of pages, then fsync() the files written to. If one tends to have
> many dirty buffers to the same file, this will group them together and
> the OS can optimize that. If one really has completely random access,
> then there is nothing to group.

Agreed. This might force enough stuff out to disk the checkpoint/sync()
would be OK. Jan, have you tested this?

--
Bruce Momjian | http://candle.pha.pa.us
pgman(at)candle(dot)pha(dot)pa(dot)us | (610) 359-1001
+ If your life is a hard drive, | 13 Roberts Road
+ Christ can be your backup. | Newtown Square, Pennsylvania 19073

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Robert Treat 2003-11-10 19:09:23 Re: What do you want me to do?
Previous Message Larry Rosenman 2003-11-10 19:05:22 Re: Experimental patch for inter-page delay in VACUUM