From: | Sutou Kouhei <kou(at)clear-code(dot)com> |
---|---|
To: | michael(at)paquier(dot)xyz |
Cc: | andres(at)anarazel(dot)de, sawada(dot)mshk(at)gmail(dot)com, zhjwpku(at)gmail(dot)com, andrew(at)dunslane(dot)net, nathandbossart(at)gmail(dot)com, pgsql-hackers(at)postgresql(dot)org |
Subject: | Re: Make COPY format extendable: Extract COPY TO format implementations |
Date: | 2024-03-01 06:44:43 |
Message-ID: | 20240301.154443.618034282613922707.kou@clear-code.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
Hi,
In <ZeFoOprWyKU6gpkP(at)paquier(dot)xyz>
"Re: Make COPY format extendable: Extract COPY TO format implementations" on Fri, 1 Mar 2024 14:31:38 +0900,
Michael Paquier <michael(at)paquier(dot)xyz> wrote:
> I guess so. It does not make much of a difference, though. The thing
> is that the dispatch caused by the custom callbacks called for each
> row is noticeable in any profiles I'm taking (not that much in the
> worst-case scenarios, still a few percents), meaning that this impacts
> the performance for all the in-core formats (text, csv, binary) as
> long as we refactor text/csv/binary to use the routines of copyapi.h.
> I don't really see a way forward, except if we don't dispatch the
> in-core formats to not impact the default cases. That makes the code
> a bit less elegant, but equally efficient for the existing formats.
It's an option based on your profile result but your
execution result also shows that v15 is faster than HEAD [1]:
> I am getting faster runtimes with v15 (6232ms in average)
> vs HEAD (6550ms) at 5M rows with COPY TO
I think that faster runtime is beneficial than mysterious
profile for users. So I think that we can merge v15 to
master.
Thanks,
--
kou
From | Date | Subject | |
---|---|---|---|
Next Message | Amit Kapila | 2024-03-01 06:45:12 | Re: Synchronizing slots from primary to standby |
Previous Message | Sutou Kouhei | 2024-03-01 06:29:17 | Re: Make COPY format extendable: Extract COPY TO format implementations |