Re: Emitting JSON to file using COPY TO

From: Junwang Zhao <zhjwpku(at)gmail(dot)com>
To: jian he <jian(dot)universality(at)gmail(dot)com>
Cc: Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>, Joe Conway <mail(at)joeconway(dot)com>, Daniel Verite <daniel(at)manitou-mail(dot)org>, Andrew Dunstan <andrew(at)dunslane(dot)net>, Davin Shearer <davin(at)apache(dot)org>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, Sutou Kouhei <kou(at)clear-code(dot)com>
Subject: Re: Emitting JSON to file using COPY TO
Date: 2024-01-27 05:55:23
Message-ID: CAEG8a3KT+UXo78qoy9EZkp96BFTojuiALQvB8wsJhWV0CCreQQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

Hi hackers,

Kou-san(CCed) has been working on *Make COPY format extendable[1]*, so
I think making *copy to json* based on that work might be the right direction.

I write an extension for that purpose, and here is the patch set together
with Kou-san's *extendable copy format* implementation:

0001-0009 is the implementation of extendable copy format
00010 is the pg_copy_json extension

I also created a PR[2] if anybody likes the github review style.

The *extendable copy format* feature is still being developed, I post this
email in case the patch set in this thread is committed without knowing
the *extendable copy format* feature.

I'd like to hear your opinions.

[1]: https://www.postgresql.org/message-id/20240124.144936.67229716500876806.kou%40clear-code.com
[2]: https://github.com/zhjwpku/postgres/pull/2/files

--
Regards
Junwang Zhao

Attachment Content-Type Size
v8-0004-Add-support-for-implementing-custom-COPY-TO-forma.patch application/octet-stream 3.3 KB
v8-0003-Export-CopyToStateData.patch application/octet-stream 13.8 KB
v8-0001-Extract-COPY-TO-format-implementations.patch application/octet-stream 23.8 KB
v8-0002-Add-support-for-adding-custom-COPY-TO-format.patch application/octet-stream 17.7 KB
v8-0005-Extract-COPY-FROM-format-implementations.patch application/octet-stream 24.8 KB
v8-0008-Add-support-for-implementing-custom-COPY-FROM-for.patch application/octet-stream 4.5 KB
v8-0007-Export-CopyFromStateData.patch application/octet-stream 17.0 KB
v8-0006-Add-support-for-adding-custom-COPY-FROM-format.patch application/octet-stream 7.0 KB
v8-0009-change-CopyToGetFormat-to-CopyToSendCopyBegin-and.patch application/octet-stream 7.6 KB
v8-0010-introduce-contrib-pg_copy_json.patch application/octet-stream 16.3 KB

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Michael Nolan 2024-01-27 20:28:43 Re: field error on refreshed materialized view
Previous Message pf 2024-01-26 18:34:25 Re: permission denied on socket

Browse pgsql-hackers by date

  From Date Subject
Next Message Junwang Zhao 2024-01-27 06:15:02 Re: Make COPY format extendable: Extract COPY TO format implementations
Previous Message Andrey Borodin 2024-01-27 04:58:18 Re: MultiXact\SLRU buffers configuration