pgsql: Fix false reports in pg_visibility

From: Alexander Korotkov <akorotkov(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Fix false reports in pg_visibility
Date: 2024-03-14 11:25:42
Message-ID: E1rkjDR-003kjA-SN@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Fix false reports in pg_visibility

Currently, pg_visibility computes its xid horizon using the
GetOldestNonRemovableTransactionId(). The problem is that this horizon can
sometimes go backward. That can lead to reporting false errors.

In order to fix that, this commit implements a new function
GetStrictOldestNonRemovableTransactionId(). This function computes the xid
horizon, which would be guaranteed to be newer or equal to any xid horizon
computed before.

We have to do the following to achieve this.

1. Ignore processes xmin's, because they consider connection to other databases
that were ignored before.
2. Ignore KnownAssignedXids, because they are not database-aware. At the same
time, the primary could compute its horizons database-aware.
3. Ignore walsender xmin, because it could go backward if some replication
connections don't use replication slots.

As a result, we're using only currently running xids to compute the horizon.
Surely these would significantly sacrifice accuracy. But we have to do so to
avoid reporting false errors.

Inspired by earlier patch by Daniel Shelepanov and the following discussion
with Robert Haas and Tom Lane.

Discussion: https://postgr.es/m/1649062270.289865713%40f403.i.mail.ru
Reviewed-by: Alexander Lakhin, Dmitry Koval

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/e85662df44ff47acdf5d2d413339445d60a9c30c

Modified Files
--------------
contrib/pg_visibility/Makefile | 1 +
contrib/pg_visibility/meson.build | 4 ++
contrib/pg_visibility/pg_visibility.c | 68 ++++++++++++++++++++--
.../pg_visibility/t/001_concurrent_transaction.pl | 47 +++++++++++++++
src/backend/storage/ipc/procarray.c | 13 ++++-
src/include/storage/standby.h | 2 +
6 files changed, 129 insertions(+), 6 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Alexander Korotkov 2024-03-14 11:39:32 pgsql: Fix contrib/pg_visibility/meson.build
Previous Message Alvaro Herrera 2024-03-14 09:27:29 pgsql: Comment out noisy libpq_pipeline test