Re: Parquet support

From: Daniele Varrazzo <daniele(dot)varrazzo(at)gmail(dot)com>
To: Vladimir Ryabtsev <greatvovan(at)gmail(dot)com>
Cc: Christopher Bader <cbader(at)zscaler(dot)com>, psycopg(at)lists(dot)postgresql(dot)org
Subject: Re: Parquet support
Date: 2022-11-23 20:00:35
Message-ID: CA+mi_8b-c8Q4zpkd=X+mqRivscEoFmn_f1UUh-wr3UjEdD+sXg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: psycopg

On Wed, 23 Nov 2022 at 20:56, Vladimir Ryabtsev <greatvovan(at)gmail(dot)com> wrote:
>
> Just curious folks, what are your thoughts about the scope of that potential support? What is the use case? Is it loading data from Parquet to Postgres (and back)? Why is the combination with Python modules like pyarrow not enough?

I am not an expert, but I understand that Python-Postgres roundtrip
goes via generating and parsing CSV files, whereas there is some
performance gain to be had by creating native arrow data.

-- Daniele

In response to

Responses

Browse psycopg by date

  From Date Subject
Next Message Brian M Hamlin 2022-11-23 20:18:43 Re: Parquet support
Previous Message Vladimir Ryabtsev 2022-11-23 19:56:07 Re: Parquet support