Re: Perf Benchmarking and regression.

From: Fabien COELHO <coelho(at)cri(dot)ensmp(dot)fr>
To: Noah Misch <noah(at)leadboat(dot)com>
Cc: Andres Freund <andres(at)anarazel(dot)de>, Robert Haas <robertmhaas(at)gmail(dot)com>, Ashutosh Sharma <ashu(dot)coek88(at)gmail(dot)com>, Mithun Cy <mithun(dot)cy(at)enterprisedb(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Subject: Re: Perf Benchmarking and regression.
Date: 2016-06-03 15:40:24
Message-ID: alpine.DEB.2.10.1606031726180.9861@sto
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers


Hello Noah,

> The usual PostgreSQL handling of a deeply workload-dependent performance
> feature is to disable it by default. That's what I'm inclined to do here, for
> every GUC the feature added. Sophisticated users will nonetheless fully
> exploit this valuable mechanism in 9.6.

>> I don't think checkpoint_flush_after is in that class, due to the
>> fsync()s we already emit at the end of checkpoints.

I agree with Andres that checkpoint_flush_after shoud not be treated as
other _flush_after settings.

> That's a promising hypothesis.

This is not an hypothesis but a proven fact. There has been hundreds of
hours of pgbenchs runs to test and demonstrate the positive impact in
various reasonable configurations.

> Some future project could impose a nonzero default
> checkpoint_flush_after, having demonstrated that it imposes negligible
> harm in the plausible cases it does not help.

I think that the significant and general benefit of checkpoint_flush_after
has been largely demonstrated and reported on the hacker thread at various
point of the development of the feature, and that it is safe, and even
highly advisable to keep it on by default.

The key point is that it is flushing sorted buffers so that it mostly
results in sequential writes. It avoids in a lot of case where the final
sync at the end of the checkpoint generates too many ios which results in
putting postgresql off line till the fsync is completed, from seconds to
minutes at a time.

The other *_flush_after do not benefit for any buffer reordering, so their
positive impact is maybe more questionnable, so I would be okay if these
are disabled by default.

--
Fabien.

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Robert Haas 2016-06-03 15:59:56 Re: Reviewing freeze map code
Previous Message Masahiko Sawada 2016-06-03 15:21:40 Re: Reviewing freeze map code