| From: | pabloa98 <pabloa98(at)gmail(dot)com> |
|---|---|
| To: | Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at> |
| Cc: | Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Mats Julian Olsen <mats(at)duneanalytics(dot)com>, "pgsql-generallists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>, wilhelm(at)duneanalytics(dot)com |
| Subject: | Re: postgres_fdw insert extremely slow |
| Date: | 2020-11-27 09:11:06 |
| Message-ID: | CAEjudX452F-MezbU6gauHaPx8EUkrafsnuuuCJD52ifiHkK5Ag@mail.gmail.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-general |
On Thu, Nov 26, 2020 at 8:25 PM Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>
wrote:
> On Thu, 2020-11-26 at 09:07 -0800, Adrian Klaver wrote:
> > So even if Mats where to break this query:
> >
> > INSERT INTO foreign.labels (address, labels)
> > SELECT address_id, ARRAY_AGG(name) AS labels
> > FROM labels
> > GROUP BY 1
> > LIMIT 100;
> >
> > down into something like this:
> >
> > INSERT INTO foreign.labels (address, labels)
> > VALUES (), (), (), ();
> >
> > postgres_fdw would send it as individual INSERTs?
>
> Yes, that's the way the FDW API works.
>
> I can confirm that it is NOT like FDW API work. I have the same problem
and in the fdw database it receives:
INSERT INTO foreign.labels (address, labels) VALUES ();
One value at a time.
Same scenario, same performance. No network related. It is just a batch
insert is split into 1 insert by row.
Pablo
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Mats Julian Olsen | 2020-11-27 12:40:48 | Re: postgres_fdw insert extremely slow |
| Previous Message | Hemil Ruparel | 2020-11-27 08:37:38 | Re: How to debug authentication issues in Postgres |