Re: O(n) tasks cause lengthy startups and checkpoints

From: "Bossart, Nathan" <bossartn(at)amazon(dot)com>
To: Bruce Momjian <bruce(at)momjian(dot)us>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, Bharath Rupireddy <bharath(dot)rupireddyforpostgres(at)gmail(dot)com>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: O(n) tasks cause lengthy startups and checkpoints
Date: 2021-12-14 20:23:57
Message-ID: C7CF1B2C-209B-4063-98EE-1617E1D4AA84@amazon.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 12/13/21, 10:21 AM, "Bossart, Nathan" <bossartn(at)amazon(dot)com> wrote:
> Thanks for chiming in. I have an almost-complete patch set that I'm
> hoping to post to the lists in the next couple of days.

As promised, here is v2. This patch set includes handling for all
four tasks noted upthread. I'd still consider this a work-in-
progress, as I've done minimal testing. At the very least, it should
demonstrate what an auxiliary process approach might look like.

Nathan

Attachment Content-Type Size
v2-0001-Introduce-custodian.patch application/octet-stream 18.6 KB
v2-0008-Move-removal-of-spilled-logical-slot-data-to-cust.patch application/octet-stream 14.2 KB
v2-0007-Use-syncfs-in-CheckPointLogicalRewriteHeap-for-sh.patch application/octet-stream 3.2 KB
v2-0006-Move-removal-of-old-logical-rewrite-mapping-files.patch application/octet-stream 8.0 KB
v2-0005-Move-removal-of-old-serialized-snapshots-to-custo.patch application/octet-stream 4.3 KB
v2-0004-Move-pgsql_tmp-file-removal-to-custodian-process.patch application/octet-stream 6.4 KB
v2-0003-Split-pgsql_tmp-cleanup-into-two-stages.patch application/octet-stream 9.8 KB
v2-0002-Also-remove-pgsql_tmp-directories-during-startup.patch application/octet-stream 4.8 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Geoghegan 2021-12-14 20:38:00 Re: Defining (and possibly skipping) useless VACUUM operations
Previous Message Juan José Santamaría Flecha 2021-12-14 20:13:52 Re: WIN32 pg_import_system_collations