Re: AIO v2.0

From: Andres Freund <andres(at)anarazel(dot)de>
To: pgsql-hackers(at)postgresql(dot)org
Cc: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>, 陈宗志 <baotiao(at)gmail(dot)com>
Subject: Re: AIO v2.0
Date: 2024-09-06 19:38:16
Message-ID: x3f32prdpgalmiieyialqtn53j5uvb2e4c47nvnjetkipq3zyk@xk7jy7fnua6w
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi,

Attached is the next version of the patchset. Changes:

- added "sync" io method, the main benefit of that is that the main AIO commit
doesn't need to include worker mode

- split worker and io_uring methods into their own commits

- added src/backend/storage/aio/README.md, explaining design constraints and
the resulting design on a high level

- renamed LWLockReleaseOwnership as suggested by Heikki

- a bunch of small cleanups and improvements

There's plenty more to do, but I thought this would be a useful checkpoint.

Greetings,

Andres Freund

Attachment Content-Type Size
v2.1-0001-bufmgr-Return-early-in-ScheduleBufferTagForWrit.patch text/x-diff 1.3 KB
v2.1-0002-Allow-lwlocks-to-be-unowned.patch text/x-diff 5.0 KB
v2.1-0003-Use-aux-process-resource-owner-in-walsender.patch text/x-diff 4.7 KB
v2.1-0004-Ensure-a-resowner-exists-for-all-paths-that-may.patch text/x-diff 2.3 KB
v2.1-0005-bufmgr-smgr-Don-t-cross-segment-boundaries-in-S.patch text/x-diff 6.2 KB
v2.1-0006-aio-Basic-subsystem-initialization.patch text/x-diff 11.6 KB
v2.1-0007-aio-Core-AIO-implementation.patch text/x-diff 66.6 KB
v2.1-0008-aio-Skeleton-IO-worker-infrastructure.patch text/x-diff 21.3 KB
v2.1-0009-aio-Add-worker-method.patch text/x-diff 18.2 KB
v2.1-0010-aio-Add-liburing-dependency.patch text/x-diff 9.9 KB
v2.1-0011-aio-Add-io_uring-method.patch text/x-diff 13.5 KB
v2.1-0012-aio-Add-README.md-explaining-higher-level-desig.patch text/x-diff 14.1 KB
v2.1-0013-aio-Implement-smgr-md.c-aio-methods.patch text/x-diff 22.6 KB
v2.1-0014-bufmgr-Implement-AIO-support.patch text/x-diff 20.9 KB
v2.1-0015-bufmgr-Use-aio-for-StartReadBuffers.patch text/x-diff 14.0 KB
v2.1-0016-aio-Very-WIP-read_stream.c-adjustments-for-real.patch text/x-diff 4.5 KB
v2.1-0017-aio-Add-IO-queue-helper.patch text/x-diff 7.2 KB
v2.1-0018-bufmgr-use-AIO-in-checkpointer-bgwriter.patch text/x-diff 31.2 KB
v2.1-0019-very-wip-test_aio-module.patch text/x-diff 38.1 KB
v2.1-0020-Temporary-Increase-BAS_BULKREAD-size.patch text/x-diff 1.3 KB

In response to

  • AIO v2.0 at 2024-09-01 06:27:50 from Andres Freund

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2024-09-06 19:43:55 Re: Remove hardcoded hash opclass function signature exceptions
Previous Message Noah Misch 2024-09-06 18:55:31 Re: race condition in pg_class