New Copy Formats - avro/orc/parquet

From: Nicolas Paris <niparisco(at)gmail(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: New Copy Formats - avro/orc/parquet
Date: 2018-02-10 15:13:04
Message-ID: 20180210151304.fonjztsynewldfba@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hello

I d'found useful to be able to import/export from postgres to those modern data
formats:
- avro (c writer=https://avro.apache.org/docs/1.8.2/api/c/index.html)
- parquet (c++ writer=https://github.com/apache/parquet-cpp)
- orc (all writers=https://github.com/apache/orc)

Something like :
COPY table TO STDOUT ORC;

Would be lovely.

This would greatly enhance how postgres integrates in big-data ecosystem.

Any thought ?

Thanks

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Adrian Klaver 2018-02-10 15:25:18 Re: New Copy Formats - avro/orc/parquet
Previous Message Carlos Martinez 2018-02-10 05:52:21 Re: Migrating Postgresql from Linux x86