Re: Autovacuum degrades all other operations by keeping all buffers dirty?

From: David Pacheco <dap(at)joyent(dot)com>
To: Andres Freund <andres(at)anarazel(dot)de>
Cc: Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>, pgsql-general(at)postgresql(dot)org
Subject: Re: Autovacuum degrades all other operations by keeping all buffers dirty?
Date: 2018-09-05 18:06:40
Message-ID: CACukRjP2gSCpoFGvRe_vUbp_ZPHjo4nbCWaJuksgT+23cC8cuA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Fri, Aug 31, 2018 at 3:50 PM, Andres Freund <andres(at)anarazel(dot)de> wrote:

> On 2018-08-31 19:31:47 -0300, Alvaro Herrera wrote:
> > On 2018-Aug-31, David Pacheco wrote:
> >
> > > From reading the 9.6.3 source, it looks like the autovacuum process
> > > itself is single-threaded, and it reads pages essentially linearly
> > > from the relation (possibly skipping some). When the autovacuum
> > > process needs to modify a page, it doesn't write it directly, but
> > > rather marks the buffer dirty. The page will be written later,
> >
> > Unless there's some bug, there is a BufferAccessStrategy that only lets
> > a few dozen buffers go unwritten before the autovac worker process
> > itself is forced to write some.
>
> I've not re-checked, but I'm not sure that's true if the buffer is
> already in s_b, which it'll be for many workloads.
>

Does that mean this analysis from above is accurate?

It looks to me like the autovacuum process is effectively generating work
> (in
> the form of async writes) that's being distributed implicitly to the
> various
> backend processes, creating latency for any other query that happens to
> require
> a buffer (including read-only queries).

Thanks,
Dave

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Michael Paquier 2018-09-05 18:15:45 Re: scram-sha-256 authentication broken in FIPS mode
Previous Message Tom Lane 2018-09-05 18:02:24 Re: Full table lock dropping a foreign key