pgsql: Read include/exclude commands for dump/restore from file

From: Daniel Gustafsson <dgustafsson(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Read include/exclude commands for dump/restore from file
Date: 2023-11-29 14:21:28
Message-ID: E1r8LRQ-007oSu-3G@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Read include/exclude commands for dump/restore from file

When there is a need to filter multiple tables with include and/or exclude
options it's quite possible to run into the limitations of the commandline.
This adds a --filter=FILENAME feature to pg_dump, pg_dumpall and pg_restore
which is used to supply a file containing object exclude/include commands
which work just like their commandline counterparts. The format of the file
is one command per row like:

<command> <object> <objectpattern>

<command> can be "include" or "exclude", <object> can be table_data, index
table_data_and_children, database, extension, foreign_data, function, table
schema, table_and_children or trigger.

This patch has gone through many revisions and design changes over a long
period of time, the list of reviewers reflect reviewers of some version of
the patch, not necessarily the final version.

Patch by Pavel Stehule with some additional hacking by me.

Author: Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com>
Reviewed-by: Justin Pryzby <pryzby(at)telsasoft(dot)com>
Reviewed-by: vignesh C <vignesh21(at)gmail(dot)com>
Reviewed-by: Dean Rasheed <dean(dot)a(dot)rasheed(at)gmail(dot)com>
Reviewed-by: Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>
Reviewed-by: Julien Rouhaud <rjuju123(at)gmail(dot)com>
Reviewed-by: Erik Rijkers <er(at)xs4all(dot)nl>
Discussion: https://postgr.es/m/CAFj8pRB10wvW0CC9Xq=1XDs=zCQxer3cbLcNZa+qiX4cUH-G_A@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/a5cf808be55bcc68c3917c380f95122436af1be1

Modified Files
--------------
doc/src/sgml/ref/pg_dump.sgml | 117 ++++
doc/src/sgml/ref/pg_dumpall.sgml | 31 ++
doc/src/sgml/ref/pg_restore.sgml | 80 +++
src/bin/pg_dump/Makefile | 5 +-
src/bin/pg_dump/filter.c | 471 ++++++++++++++++
src/bin/pg_dump/filter.h | 71 +++
src/bin/pg_dump/meson.build | 2 +
src/bin/pg_dump/pg_dump.c | 118 ++++
src/bin/pg_dump/pg_dumpall.c | 67 +++
src/bin/pg_dump/pg_restore.c | 109 ++++
src/bin/pg_dump/t/005_pg_dump_filterfile.pl | 799 ++++++++++++++++++++++++++++
src/tools/msvc/Mkvcbuild.pm | 1 +
src/tools/pgindent/typedefs.list | 3 +
13 files changed, 1872 insertions(+), 2 deletions(-)

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message Andrew Dunstan 2023-11-29 15:05:26 Re: pgsql: meson: docs: Add {html,man} targets, rename install-doc-*
Previous Message Tom Lane 2023-11-29 13:49:52 Re: pgsql: meson: docs: Add {html,man} targets, rename install-doc-*