pgsql: Add TID Range Scans to support efficient scanning ranges of TIDs

From: David Rowley <drowley(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Add TID Range Scans to support efficient scanning ranges of TIDs
Date: 2021-02-27 10:01:03
Message-ID: E1lFwPH-0002fZ-QI@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Add TID Range Scans to support efficient scanning ranges of TIDs

This adds a new executor node named TID Range Scan. The query planner
will generate paths for TID Range scans when quals are discovered on base
relations which search for ranges on the table's ctid column. These
ranges may be open at either end. For example, WHERE ctid >= '(10,0)';
will return all tuples on page 10 and over.

To support this, two new optional callback functions have been added to
table AM. scan_set_tidrange is used to set the scan range to just the
given range of TIDs. scan_getnextslot_tidrange fetches the next tuple
in the given range.

For AMs were scanning ranges of TIDs would not make sense, these functions
can be set to NULL in the TableAmRoutine. The query planner won't
generate TID Range Scan Paths in that case.

Author: Edmund Horner, David Rowley
Reviewed-by: David Rowley, Tomas Vondra, Tom Lane, Andres Freund, Zhihong Yu
Discussion: https://postgr.es/m/CAMyN-kB-nFTkF=VA_JPwFNo08S0d-Yk0F741S2B7LDmYAi8eyA@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/bb437f995d47405ecd92cf66df71f7f7e40ed460

Modified Files
--------------
src/backend/access/heap/heapam.c | 147 ++++++++++
src/backend/access/heap/heapam_handler.c | 3 +
src/backend/commands/explain.c | 23 ++
src/backend/executor/Makefile | 1 +
src/backend/executor/execAmi.c | 6 +
src/backend/executor/execCurrent.c | 1 +
src/backend/executor/execProcnode.c | 10 +
src/backend/executor/nodeTidrangescan.c | 413 +++++++++++++++++++++++++++++
src/backend/nodes/copyfuncs.c | 24 ++
src/backend/nodes/outfuncs.c | 14 +
src/backend/optimizer/README | 1 +
src/backend/optimizer/path/costsize.c | 95 +++++++
src/backend/optimizer/path/tidpath.c | 119 ++++++++-
src/backend/optimizer/plan/createplan.c | 98 +++++++
src/backend/optimizer/plan/setrefs.c | 16 ++
src/backend/optimizer/plan/subselect.c | 6 +
src/backend/optimizer/util/pathnode.c | 29 ++
src/backend/optimizer/util/plancat.c | 6 +
src/backend/optimizer/util/relnode.c | 3 +
src/backend/storage/page/itemptr.c | 59 +++++
src/include/access/heapam.h | 6 +-
src/include/access/relscan.h | 4 +
src/include/access/tableam.h | 97 ++++++-
src/include/catalog/pg_operator.dat | 6 +-
src/include/executor/nodeTidrangescan.h | 24 ++
src/include/nodes/execnodes.h | 18 ++
src/include/nodes/nodes.h | 3 +
src/include/nodes/pathnodes.h | 18 ++
src/include/nodes/plannodes.h | 13 +
src/include/optimizer/cost.h | 3 +
src/include/optimizer/pathnode.h | 4 +
src/include/storage/itemptr.h | 2 +
src/test/regress/expected/tidrangescan.out | 300 +++++++++++++++++++++
src/test/regress/parallel_schedule | 2 +-
src/test/regress/serial_schedule | 1 +
src/test/regress/sql/tidrangescan.sql | 101 +++++++
36 files changed, 1654 insertions(+), 22 deletions(-)

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message David Rowley 2021-02-27 10:22:00 pgsql: Add missing TidRangeScan readfunc
Previous Message Peter Eisentraut 2021-02-27 07:15:41 pgsql: Enhanced cycle mark values