| From: | "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> |
|---|---|
| To: | Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com> |
| Cc: | 'Amit Langote' <amitlangote09(at)gmail(dot)com>, "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>, Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | RE: POC: postgres_fdw insert batching |
| Date: | 2021-01-18 06:51:45 |
| Message-ID: | OSBPR01MB29820BAA17AD3A79A49935EFFEA40@OSBPR01MB2982.jpnprd01.prod.outlook.com |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
Tomas-san,
From: Amit Langote <amitlangote09(at)gmail(dot)com>
> Good thing you reminded me that this is about inserts, and in that
> case no, ExecInitModifyTable() doesn't know all leaf partitions, it
> only sees the root table whose batch_size doesn't really matter. So
> it's really ExecInitRoutingInfo() that I would recommend to set
> ri_BatchSize; right after this block:
>
> /*
> * If the partition is a foreign table, let the FDW init itself for
> * routing tuples to the partition.
> */
> if (partRelInfo->ri_FdwRoutine != NULL &&
> partRelInfo->ri_FdwRoutine->BeginForeignInsert != NULL)
> partRelInfo->ri_FdwRoutine->BeginForeignInsert(mtstate, partRelInfo);
>
> Note that ExecInitRoutingInfo() is called only once for a partition
> when it is initialized after being inserted into for the first time.
>
> For a non-partitioned targets, I'd still say set ri_BatchSize in
> ExecInitModifyTable().
Attached is the patch that added call to GetModifyBatchSize() to the above two places. The regression test passes.
(FWIW, frankly, I prefer the previous version because the code is a bit smaller... Maybe we should refactor the code someday to reduce similar processings in both the partitioned case and non-partitioned case.)
Regards
Takayuki Tsunakawa
| Attachment | Content-Type | Size |
|---|---|---|
| v10-0001-Add-bulk-insert-for-foreign-tables.patch | application/octet-stream | 50.1 KB |
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Noah Misch | 2021-01-18 07:02:18 | Re: Wrong usage of RelationNeedsWAL |
| Previous Message | Amit Kapila | 2021-01-18 06:46:33 | Re: Deleting older versions in unique indexes to avoid page splits |