Re: Increasing parallelism of queries while using file fdw and partitions

From: Justin Pryzby <pryzby(at)telsasoft(dot)com>
To: Patrick Mulrooney <mulroony(at)gmail(dot)com>
Cc: pgsql-performance(at)lists(dot)postgresql(dot)org
Subject: Re: Increasing parallelism of queries while using file fdw and partitions
Date: 2018-12-19 06:51:49
Message-ID: 20181219065149.GF8042@telsasoft.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Tue, Dec 18, 2018 at 08:39:36PM -0800, Patrick Mulrooney wrote:
> Wondering if anyone had any thoughts on how to tweak my setup to get it to
> read many files at once instead of one at a time when using file fdw and
> partitions.

I found this:

https://www.postgresql.org/docs/current/parallel-safety.html
|The following operations are always parallel restricted.
|Scans of foreign tables, unless the foreign data wrapper has an IsForeignScanParallelSafe API which indicates otherwise.

https://github.com/ergo70/vcf_fdw/blob/master/vcf_fdw/__init__.py
=> has no such API marker, since it's couple years old, same as multicorn.

Justin

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Patrick Mulrooney 2018-12-19 07:36:45 Re: Increasing parallelism of queries while using file fdw and partitions
Previous Message David Rowley 2018-12-19 06:33:41 Re: SQL Perfomance during autovacuum