pgsql: Provide vectored variants of smgrread() and smgrwrite().

From: Thomas Munro <tmunro(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Provide vectored variants of smgrread() and smgrwrite().
Date: 2023-12-18 02:09:03
Message-ID: E1rF342-00AhnX-NB@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Provide vectored variants of smgrread() and smgrwrite().

smgrreadv() and smgrwritev() and their md.c implementations call
FileReadV() and FileWriteV(). A range of disk blocks beginning at
'blocknum' and extending for 'nblocks' can be scattered to or gathered
from multiple buffers with a single system call. The traditional
smgrread() and smgrwrite() functions are implemented in terms of the new
functions.

Later commits will introduce calls with nblocks > 1, but the following
behavioral changes can be seen already:

* After a short transfer we'll now retry until we eventually read 0
bytes (= EOF) or get ENOSPC, EDQUOT, EFBIG etc, where previously we
would infer the reason. Retrying is consistent with xlog.c's
treatment of large WAL writes, and arguably also xlog.c and fd.c's
treatment of EINTR. Arbitrary short returns for larger transfers have
been observed on several OSes, and might in theory also happen for
transient reasons with our own pg_p*v() fallback code.

* After unexpected EOF or -1, the error thrown now talks about
a range even for the single block case, eg "blocks 42..42".

Reviewed-by: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>
Discussion: https://postgr.es/m/CA+hUKGJkOiOCa+mag4BF+zHo7qo=o9CFheB8=g6uT5TUm2gkvA@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/4908c5872059c409aa647bcde758dfeffe07996e

Modified Files
--------------
doc/src/sgml/monitoring.sgml | 4 +-
src/backend/storage/smgr/md.c | 325 ++++++++++++++++++++++++++++------------
src/backend/storage/smgr/smgr.c | 37 ++---
src/include/storage/md.h | 9 +-
src/include/storage/smgr.h | 25 +++-
5 files changed, 279 insertions(+), 121 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Nathan Bossart 2023-12-18 16:34:56 pgsql: Micro-optimize datum_to_json_internal() some more.
Previous Message Tom Lane 2023-12-17 21:50:04 pgsql: Doc: add a bit to indices.sgml about what is an indexable clause