pgsql: Immediately WAL-log subtransaction and top-level XID association

From: Amit Kapila <akapila(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Immediately WAL-log subtransaction and top-level XID association
Date: 2020-07-20 03:26:00
Message-ID: E1jxMRE-0002Gi-Cs@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Immediately WAL-log subtransaction and top-level XID association.

The logical decoding infrastructure needs to know which top-level
transaction the subxact belongs to, in order to decode all the
changes. Until now that might be delayed until commit, due to the
caching (GPROC_MAX_CACHED_SUBXIDS), preventing features requiring
incremental decoding.

So we also write the assignment info into WAL immediately, as part
of the next WAL record (to minimize overhead) only when wal_level=logical.
We can not remove the existing XLOG_XACT_ASSIGNMENT WAL as that is
required for avoiding overflow in the hot standby snapshot.

Bump XLOG_PAGE_MAGIC, since this introduces XLR_BLOCK_ID_TOPLEVEL_XID.

Author: Tomas Vondra, Dilip Kumar, Amit Kapila
Reviewed-by: Amit Kapila
Tested-by: Neha Sharma and Mahendra Singh Thalor
Discussion: https://postgr.es/m/688b0b7f-2f6c-d827-c27b-216a8e3ea700@2ndquadrant.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/0bead9af484c1d0a67e690fda47011addaa5bc9d

Modified Files
--------------
src/backend/access/transam/xact.c | 50 ++++++++++++++++++++++++++++++++
src/backend/access/transam/xloginsert.c | 23 +++++++++++++--
src/backend/access/transam/xlogreader.c | 5 ++++
src/backend/replication/logical/decode.c | 44 ++++++++++++++--------------
src/include/access/xact.h | 3 ++
src/include/access/xlog.h | 1 +
src/include/access/xlog_internal.h | 2 +-
src/include/access/xlogreader.h | 3 ++
src/include/access/xlogrecord.h | 1 +
9 files changed, 108 insertions(+), 24 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Fujii Masao 2020-07-20 04:35:19 pgsql: Rename wal_keep_segments to wal_keep_size.
Previous Message Fujii Masao 2020-07-20 02:56:22 pgsql: Add generic_plans and custom_plans fields into pg_prepared_state