From: | Michael Paquier <michael(at)paquier(dot)xyz> |
---|---|
To: | Sutou Kouhei <kou(at)clear-code(dot)com> |
Cc: | sawada(dot)mshk(at)gmail(dot)com, zhjwpku(at)gmail(dot)com, pgsql-hackers(at)postgresql(dot)org |
Subject: | Re: Make COPY format extendable: Extract COPY TO format implementations |
Date: | 2025-02-05 05:10:15 |
Message-ID: | Z6Lyt_7RN-0vhqpi@paquier.xyz |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
On Sat, Feb 01, 2025 at 07:12:01PM +0900, Sutou Kouhei wrote:
> For the propose, copyapi.h should not include
> copy{to,from}_internal.h. If we do it, copyto.c includes
> CopyFromState and copyfrom*.c include CopyToState.
>
> What do you think about the following change? Note that
> extensions must include copy{to,from}_internal.h explicitly
> in addition to copyapi.h.
I was just looking at bit at this series of patch labelled with v31,
to see what is happening here.
In 0001, we have that:
+ /* format-specific routines */
+ const CopyToRoutine *routine;
[...]
- CopySendEndOfRow(cstate);
+ cstate->routine->CopyToOneRow(cstate, slot);
Having a callback where the copy state is processed once per row is
neat in terms of design for the callbacks and what extensions can do,
and this is much better than what 2889fd23be5 has attempted (later
reverted in 1aa8324b81fa) because we don't do indirect function calls
for each attribute. Still, I have a question here: what happens for a
COPY TO that involves one attribute, a short field size like an int2
and many rows (the more rows the more pronounced the effect, of
course)? Could this level of indirection still be the cause of some
regressions in a case like that? This is the worst case I can think
about, on top of my mind, and I am not seeing tests with few
attributes like this one, where we would try to make this callback as
hot as possible. This is a performance-sensitive area.
--
Michael
From | Date | Subject | |
---|---|---|---|
Next Message | Shlok Kyal | 2025-02-05 05:22:41 | Re: Adding a '--clean-publisher-objects' option to 'pg_createsubscriber' utility. |
Previous Message | vignesh C | 2025-02-05 04:59:52 | Re: Introduce XID age and inactive timeout based replication slot invalidation |