| From: | Manuel Kniep <m(dot)kniep(at)web(dot)de> |
|---|---|
| To: | Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp> |
| Cc: | pgsql-hackers(at)postgresql(dot)org |
| Subject: | Re: parallel foreign scan |
| Date: | 2018-05-16 13:23:05 |
| Message-ID: | 28CA2456-9A5B-4FF5-B975-1F0B8CA5680C@web.de |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
> I think you are trying collecting data from multple kafka
> server. This means each server has a dedicate foreign table on a
> dedicate foreign server. Parallel execution doesn't fit in that
> case since it works on single base relation (or a
> table). Parallel append/merge append look a bit different but
> actually is the same in the sense that one base relation is
> scanned on multiple workers. Even if you are trying to fetch from
> one kafka stream on multiple workers, I think the fdw driver
> doesn't support parallel scanning anyway.
Well my idea was to to scan multiple partitions from a single kafka
server / topic in parallel.
I’ll will look into your suggestion to set up partial paths
regards
Manuel
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Robert Haas | 2018-05-16 13:33:46 | Re: [PROPOSAL] Shared Ispell dictionaries |
| Previous Message | Robert Haas | 2018-05-16 13:19:20 | Re: Should we add GUCs to allow partition pruning to be disabled? |