Re: New Copy Formats - avro/orc/parquet

From: "David G(dot) Johnston" <david(dot)g(dot)johnston(at)gmail(dot)com>
To: Nicolas Paris <niparisco(at)gmail(dot)com>
Cc: "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: New Copy Formats - avro/orc/parquet
Date: 2018-02-10 15:38:10
Message-ID: CAKFQuwbeLaUD9iXmUExNrOTmdZVqTFnaHc+LQGh0ge5xcnaLeQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Saturday, February 10, 2018, Nicolas Paris <niparisco(at)gmail(dot)com> wrote:

> Hello
>
> I d'found useful to be able to import/export from postgres to those modern
> data
> formats:
> - avro (c writer=https://avro.apache.org/docs/1.8.2/api/c/index.html)
> - parquet (c++ writer=https://github.com/apache/parquet-cpp)
> - orc (all writers=https://github.com/apache/orc)
>
> Something like :
> COPY table TO STDOUT ORC;
>
> Would be lovely.
>
> This would greatly enhance how postgres integrates in big-data ecosystem.
>
>
It would be written "... with (format 'orc')" and your best bet would be to
create an extension. I don't think that having such code in core (or
contrib) is desirable.

David J.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Tomas Vondra 2018-02-10 17:19:23 Re: New Copy Formats - avro/orc/parquet
Previous Message Nicolas Paris 2018-02-10 15:30:11 Re: New Copy Formats - avro/orc/parquet