Re: parallel foreign scan

From: Manuel Kniep <m(dot)kniep(at)web(dot)de>
To: Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: parallel foreign scan
Date: 2018-05-16 13:23:05
Message-ID: 28CA2456-9A5B-4FF5-B975-1F0B8CA5680C@web.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers


> I think you are trying collecting data from multple kafka
> server. This means each server has a dedicate foreign table on a
> dedicate foreign server. Parallel execution doesn't fit in that
> case since it works on single base relation (or a
> table). Parallel append/merge append look a bit different but
> actually is the same in the sense that one base relation is
> scanned on multiple workers. Even if you are trying to fetch from
> one kafka stream on multiple workers, I think the fdw driver
> doesn't support parallel scanning anyway.

Well my idea was to to scan multiple partitions from a single kafka
server / topic in parallel.
I’ll will look into your suggestion to set up partial paths

regards

Manuel

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Robert Haas 2018-05-16 13:33:46 Re: [PROPOSAL] Shared Ispell dictionaries
Previous Message Robert Haas 2018-05-16 13:19:20 Re: Should we add GUCs to allow partition pruning to be disabled?