Re: Parallel heap vacuum

From: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
To: Dilip Kumar <dilipbalaut(at)gmail(dot)com>
Cc: Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, Melanie Plageman <melanieplageman(at)gmail(dot)com>, John Naylor <johncnaylorls(at)gmail(dot)com>, Tomas Vondra <tomas(at)vondra(dot)me>, "Hayato Kuroda (Fujitsu)" <kuroda(dot)hayato(at)fujitsu(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Parallel heap vacuum
Date: 2025-03-12 10:10:26
Message-ID: CAA4eK1Jv7hrZNN=MGX34a5HqDRK3UV533aqPoaOHG3htGOi1DQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, Mar 12, 2025 at 11:24 AM Dilip Kumar <dilipbalaut(at)gmail(dot)com> wrote:
>
> On Wed, Mar 12, 2025 at 3:17 AM Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> wrote:
> >
> > On Tue, Mar 11, 2025 at 5:51 AM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
> > >
>
> Some thoughts/questions on the idea
>
> I notice that we are always considering block-level parallelism for
> heaps and object-level parallelism for indexes. I'm wondering, when
> multiple tables are being vacuumed together—either because the user
> has provided a list of tables or has specified a partitioned table
> with multiple children—does it still make sense to default to
> block-level parallelism? Or could we consider table-level parallelism
> in such cases? For example, if there are 4 tables and 6 workers, with
> 2 tables being small and the other 2 being large, perhaps we could
> allocate 4 workers to vacuum all 4 tables in parallel. For the larger
> tables, we could apply block-level parallelism, using more workers for
> internal parallelism. On the other hand, if all tables are small, we
> could just apply table-level parallelism without needing block-level
> parallelism at all. This approach could offer more flexibility, isn't
> it?
>

I have not thought from this angle, but it seems we can build this
even on top of block-level vacuum for large tables.

--
With Regards,
Amit Kapila.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Dilip Kumar 2025-03-12 10:18:32 Re: Parallel heap vacuum
Previous Message Álvaro Herrera 2025-03-12 10:09:03 Re: Question about duplicate JSONTYPE_JSON check