Re: define PG_REPLSLOT_DIR

From: Bertrand Drouvot <bertranddrouvot(dot)pg(at)gmail(dot)com>
To: Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>
Cc: pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: define PG_REPLSLOT_DIR
Date: 2024-08-19 14:11:55
Message-ID: ZsNSq9jcGQH2OMTN@ip-10-97-1-34.eu-west-3.compute.internal
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi,

On Thu, Aug 15, 2024 at 08:40:42PM -0400, Alvaro Herrera wrote:
> On 2024-Aug-14, Bertrand Drouvot wrote:
>
> > Out of curiosity, checking the sizes of affected files (O2, no debug):
> >
> > with patch:
> >
> > text data bss dec hex filename
> > 30304 0 8 30312 7668 src/backend/replication/logical/reorderbuffer.o
>
> > without patch:
> > 30286 0 8 30294 7656 src/backend/replication/logical/reorderbuffer.o
>
> Hmm, I suppose this delta can be explained because because the literal
> string is used inside larger snprintf() format strings or similar, so
> things like
>
> snprintf(path, sizeof(path),
> - "pg_replslot/%s/%s", slotname,
> + "%s/%s/%s", PG_REPLSLOT_DIR, slotname,
> spill_de->d_name);
>
> and
>
> ereport(ERROR,
> (errcode_for_file_access(),
> - errmsg("could not remove file \"%s\" during removal of pg_replslot/%s/xid*: %m",
> - path, slotname)));
> + errmsg("could not remove file \"%s\" during removal of %s/%s/xid*: %m",
> + PG_REPLSLOT_DIR, path, slotname)));
>

I did not look in details, but yeah that could probably be explained that way.

> I don't disagree with making this change, but changing some of the other
> directory names you suggest, such as
>
> > pg_notify
> > pg_serial
> > pg_subtrans
> > pg_multixact
> > pg_wal
>
> would probably make no difference, since there are no literal strings
> that contain that as a substring(*). It might some sense to handle
> pg_tblspc similarly. As for pg_logical, I think you'll want separate
> defines for pg_logical/mappings, pg_logical/snapshots and so on.
>
>
> (*) I hope you're not going to suggest this kind of change (word-diff):
>
> if (GetOldestSnapshot())
> ereport(ERROR,
> (errcode(ERRCODE_OBJECT_NOT_IN_PREREQUISITE_STATE),
> errmsg("[-pg_wal-]{+%s+}_replay_wait() must be only called without an active or registered snapshot"{+, PG_WAL_DIR+}),
> errdetail("Make sure [-pg_wal-]{+%s+}_replay_wait() isn't called within a transaction with an isolation level higher than READ COMMITTED, another procedure, or a function."{+, PG_WAL_DIR+})));
>

Yeah, would not cross my mind ;-). I might have been tempted to do the change
in pg_combinebackup.c though.

Having said that, I agree to focus only on:

pg_replslot
pg_tblspc
pg_logical/*

I made the changes for pg_tblspc in pg_combinebackup.c as the number of occurences
are greater that the "pg_wal" ones and we were to define PG_TBLSPC_DIR in any
case.

Please find attached the related patches.

Regards,

--
Bertrand Drouvot
PostgreSQL Contributors Team
RDS Open Source Databases
Amazon Web Services: https://aws.amazon.com

Attachment Content-Type Size
v2-0001-Define-PG_REPLSLOT_DIR.patch text/x-diff 10.9 KB
v2-0002-Define-PG_LOGICAL_MAPPINGS_DIR.patch text/x-diff 5.3 KB
v2-0003-Define-PG_LOGICAL_SNAPSHOTS_DIR.patch text/x-diff 5.6 KB
v2-0004-Define-PG_LOGICAL_REPLORIGIN_CHECKPOINT_DIR.patch text/x-diff 2.0 KB
v2-0005-Define-PG_TBLSPC_DIR.patch text/x-diff 36.4 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2024-08-19 14:12:43 Re: Improve pg_re_throw: check if sigjmp_buf is valid and report error
Previous Message Aleksander Alekseev 2024-08-19 14:10:15 Re: [PATCH] Add get_bytes() and set_bytes() functions