From: | "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> |
---|---|
To: | 'Tomas Vondra' <tomas(dot)vondra(at)enterprisedb(dot)com>, 'Craig Ringer' <craig(dot)ringer(at)enterprisedb(dot)com> |
Cc: | Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org>, Andres Freund <andres(at)anarazel(dot)de> |
Subject: | RE: POC: postgres_fdw insert batching |
Date: | 2020-11-27 02:47:51 |
Message-ID: | TYAPR01MB29908B1A9704D1D85ECF09BEFEF80@TYAPR01MB2990.jpnprd01.prod.outlook.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
From: Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>
> Not sure how is this related to app developers? I think the idea was
> that the libpq features might be useful between the two PostgreSQL
> instances. I.e. the postgres_fdw would use the libpq batching to send
> chunks of data to the other side.
> Well, my point was that we could keep the API, but maybe it should be
> implemented using the proposed libpq batching. They could still use the
> postgres_fdw example how to use the API, but the internals would need to
> be different, of course.
Yes, I understand them. I just wondered if app developers use the statement batching API for libpq or JDBC in what kind of apps. That is, I talked about the batching API itself, not related to FDW. (So, I mentioned I think I should ask such a question in the libpq batching thread.)
I expect postgresExecForeignBatchInsert() would be able to use the libpq batching API, because it receives an array of tuples and can generate and issue INSERT statement for each tuple. But I'm not sure either if the libpq batching is likely to be committed in the near future. (The thread looks too long...) Anyway, this thread's batch insert can be progressed (and hopefully committed), and once the libpq batching has been committed, we can give it a try to use it and modify postgres_fdw to see if we can get further performance boost.
Regards
Takayuki Tsunakawa
From | Date | Subject | |
---|---|---|---|
Next Message | Kyotaro Horiguchi | 2020-11-27 03:05:45 | Re: Allow some recovery parameters to be changed with reload |
Previous Message | Andy Fan | 2020-11-27 02:36:45 | Re: Hybrid Hash/Nested Loop joins and caching results from subplans |