Re: Lock-free compaction. Why not?

From: Ahmed Yarub Hani Al Nuaimi <ahmedyarubhani(at)gmail(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: David Rowley <dgrowleyml(at)gmail(dot)com>, Pg Hackers <pgsql-hackers(at)postgresql(dot)org>, Robert Haas <robertmhaas(at)gmail(dot)com>, Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>
Subject: Re: Lock-free compaction. Why not?
Date: 2024-07-20 16:00:05
Message-ID: CAF239vqnUs9O71WVc5eFS-tkGV3AdTsDbrL5hAOXU05h_9q_dw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Wow I was busy for a controle of days and now I’m again fully committed to
this initiative. These ideas are extremely useful to my. I’ll first start
by reading the old in-place implementation, but meanwhile I have the
following questions:
1- I’m thinking of adding only one simple step to be auto-vacuum. This
means that there will neither be excessive locking nor resource
utilization. I guess my question is: does that simple step make the current
lazy auto-vacuum much worse?
2- Can you point me to a resource explaining why this might lead to index
bloating?

Em qui., 18 de jul. de 2024 às 15:21, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> escreveu:

> Robert Haas <robertmhaas(at)gmail(dot)com> writes:
> > On Thu, Jul 18, 2024 at 7:08 AM David Rowley <dgrowleyml(at)gmail(dot)com>
> wrote:
> >> I think the primary issue with the old way was index bloat wasn't
> >> fixed. The release notes for 9.0 do claim the CLUSTER method "is
> >> substantially faster in most cases", however, I imagine there are
> >> plenty of cases where it wouldn't be. e.g, it's hard to imagine
> >> rewriting the entire 1TB table and indexes is cheaper than moving 1
> >> row out of place row.
>
> > The other thing I remember besides index bloat is that it was
> > crushingly slow.
>
> Yeah. The old way was great if there really were just a few tuples
> needing to be moved ... but by the time you decide you need VACUUM
> FULL rather than plain VACUUM, that's unlikely to be the case.
>
> regards, tom lane
>

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message vignesh C 2024-07-20 16:01:06 Re: Slow catchup of 2PC (twophase) transactions on replica in LR
Previous Message vignesh C 2024-07-20 15:18:16 Re: Logical Replication of sequences