Re: Parallel heap vacuum

From: Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>
To: Melanie Plageman <melanieplageman(at)gmail(dot)com>
Cc: Peter Smith <smithpb2250(at)gmail(dot)com>, John Naylor <johncnaylorls(at)gmail(dot)com>, Tomas Vondra <tomas(at)vondra(dot)me>, "Hayato Kuroda (Fujitsu)" <kuroda(dot)hayato(at)fujitsu(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Parallel heap vacuum
Date: 2025-03-11 21:21:42
Message-ID: CAD21AoDBLdry=LudSkw4=gX9z_MFGxn1rwsNFifDXvNNGV+g2w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Mon, Mar 10, 2025 at 5:03 PM Melanie Plageman
<melanieplageman(at)gmail(dot)com> wrote:
>
> On Sat, Mar 8, 2025 at 1:42 AM Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> wrote:
> >
> >
> > I've attached the updated version patches.
>
> I've started trying to review this and realized that, while I'm
> familiar with heap vacuuming code, I'm not familiar enough with the
> vacuumparallel.c machinery to be of help without much additional
> study. As such, I have mainly focused on reading the comments in your
> code.

Thank you for looking at the patch.

>
> I think your comment in vacuumlazy.c describing the design could use
> more detail and a bit of massaging.
>
> For example, I don't know what you mean when you say:
>
> * We could require different number of parallel vacuum workers for each phase
> * for various factors such as table size and number of indexes.
>
> Does that refer to something you did implement or you are saying we
> could do that in the future?

It referred to the parallel heap vacuum implementation that I wrote.
Since the parallel degrees for parallel heap scan and parallel index
vacuuming are chosen separately based on different factors, we launch
a different number of workers for each phase and they exit at the end
of each phase.

Regards,

--
Masahiko Sawada
Amazon Web Services: https://aws.amazon.com

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Alexander Korotkov 2025-03-11 21:33:25 Re: pgsql: reindexdb: Add the index-level REINDEX with multiple jobs
Previous Message Masahiko Sawada 2025-03-11 21:14:52 Re: maintenance_work_mem = 64kB doesn't work for vacuum