Re: optimizing pg_upgrade's once-in-each-database steps

From: Nathan Bossart <nathandbossart(at)gmail(dot)com>
To: Robert Haas <robertmhaas(at)gmail(dot)com>
Cc: Jeff Davis <pgsql(at)j-davis(dot)com>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: optimizing pg_upgrade's once-in-each-database steps
Date: 2024-07-09 03:33:13
Message-ID: ZoyveaS6a6jyhYS6@nathan
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

I finished parallelizing everything in pg_upgrade I could easily
parallelize with the proposed async task API. There are a few remaining
places where I could not easily convert to the new API for whatever reason.
AFAICT those remaining places are either not showing up prominently in my
tests, or they only affect versions that are unsupported or will soon be
unsupported when v18 is released. Similarly, I noticed many of the checks
follow a very similar coding pattern, but most (if not all) only affect
older versions, so I'm unsure whether it's worth the trouble to try
consolidating them into one scan through all the databases.

The code is still very rough and nowhere near committable, but this at
least gets the patch set into the editing phase.

--
nathan

Attachment Content-Type Size
v4-0001-introduce-framework-for-parallelizing-pg_upgrade-.patch text/plain 10.0 KB
v4-0002-use-new-pg_upgrade-async-API-for-subscription-sta.patch text/plain 8.8 KB
v4-0003-move-live_check-variable-to-user_opts.patch text/plain 11.8 KB
v4-0004-use-new-pg_upgrade-async-API-for-retrieving-relin.patch text/plain 11.1 KB
v4-0005-use-new-pg_upgrade-async-API-to-parallelize-getti.patch text/plain 3.4 KB
v4-0006-use-new-pg_upgrade-async-API-to-parallelize-repor.patch text/plain 3.4 KB
v4-0007-parallelize-data-type-checks-in-pg_upgrade.patch text/plain 12.4 KB
v4-0008-parallelize-isn-and-int8-passing-mismatch-check-i.patch text/plain 3.7 KB
v4-0009-parallelize-user-defined-postfix-ops-check-in-pg_.patch text/plain 5.3 KB
v4-0010-parallelize-incompatible-polymorphics-check-in-pg.patch text/plain 8.7 KB
v4-0011-parallelize-tables-with-oids-check-in-pg_upgrade.patch text/plain 3.6 KB
v4-0012-parallelize-user-defined-encoding-conversions-che.patch text/plain 4.4 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Michael Paquier 2024-07-09 04:14:53 Re: Injection point locking
Previous Message Amit Langote 2024-07-09 03:30:35 Re: Doc Rework: Section 9.16.13 SQL/JSON Query Functions