Parquet S3 FDW 0.1 was newly released

Posted on 2021-03-03 by Toshiba
Related Open Source

We have just released version 0.1 of the Foreign Data Wrapper for Parquet file on Amazon S3. This release can work with PostgreSQL 13.

The code is based on parquet_fdw created by adjust GmbH. This FDW supports following features as same as the original parquet_fdw :

  • Support SELECT of parquet file on local file system.
  • Support to create a foreign table for multiple files by specifying file paths.

This FDW supports following features in addition to the original parquet_fdw :

  • Support SELECT of parquet file on Amazon S3.
  • Support MinIO access instead of Amazon S3.
  • Support to create a foreign table for multiple files in a directory by specifying a directory path.

This is developed by Toshiba Software Engineering & Technology Center. Please see the repository for details.

Source repository : https://github.com/pgspider/parquet_s3_fdw