pgsql: syncrep parser: pure parser and reentrant scanner

From: Peter Eisentraut <peter(at)eisentraut(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: syncrep parser: pure parser and reentrant scanner
Date: 2024-12-24 17:09:42
Message-ID: E1tQ8Pd-0018Uu-OT@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

syncrep parser: pure parser and reentrant scanner

Use the flex %option reentrant and the bison option %pure-parser to
make the generated scanner and parser pure, reentrant, and
thread-safe.

Make the generated scanner use palloc() etc. instead of malloc() etc.
Previously, we only used palloc() for the buffer, but flex would still
use malloc() for its internal structures. Now, all the memory is
under palloc() control.

Simplify flex scan buffer management: Instead of constructing the
buffer from pieces and then using yy_scan_buffer(), we can just use
yy_scan_string(), which does the same thing internally.

The previous code was necessary because we allocated the buffer with
palloc() and the rest of the state was handled by malloc(). But this
is no longer the case; everything is under palloc() now.

Use flex yyextra to handle context information, instead of global
variables. This complements the other changes to make the scanner
reentrant.

Reviewed-by: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>
Reviewed-by: Andreas Karlsson <andreas(at)proxel(dot)se>
Discussion: https://www.postgresql.org/message-id/flat/eb6faeac-2a8a-4b69-9189-c33c520e5b7b(at)eisentraut(dot)org

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/db6856c9913f1af08b5d7bde442fae362913190a

Modified Files
--------------
src/backend/nls.mk | 2 +-
src/backend/replication/syncrep.c | 7 +-
src/backend/replication/syncrep_gram.y | 12 ++--
src/backend/replication/syncrep_scanner.l | 105 +++++++++++++++++++-----------
src/include/replication/syncrep.h | 15 +++--
5 files changed, 90 insertions(+), 51 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Peter Geoghegan 2024-12-24 19:07:10 pgsql: Fix nbtree symbol name comment reference.
Previous Message Peter Eisentraut 2024-12-24 15:43:29 pgsql: replication parser: pure parser and reentrant scanner