From: | Manuel Kniep <m(dot)kniep(at)web(dot)de> |
---|---|
To: | Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp> |
Cc: | pgsql-hackers(at)postgresql(dot)org |
Subject: | Re: parallel foreign scan |
Date: | 2018-05-16 13:23:05 |
Message-ID: | 28CA2456-9A5B-4FF5-B975-1F0B8CA5680C@web.de |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
> I think you are trying collecting data from multple kafka
> server. This means each server has a dedicate foreign table on a
> dedicate foreign server. Parallel execution doesn't fit in that
> case since it works on single base relation (or a
> table). Parallel append/merge append look a bit different but
> actually is the same in the sense that one base relation is
> scanned on multiple workers. Even if you are trying to fetch from
> one kafka stream on multiple workers, I think the fdw driver
> doesn't support parallel scanning anyway.
Well my idea was to to scan multiple partitions from a single kafka
server / topic in parallel.
I’ll will look into your suggestion to set up partial paths
regards
Manuel
From | Date | Subject | |
---|---|---|---|
Next Message | Robert Haas | 2018-05-16 13:33:46 | Re: [PROPOSAL] Shared Ispell dictionaries |
Previous Message | Robert Haas | 2018-05-16 13:19:20 | Re: Should we add GUCs to allow partition pruning to be disabled? |