Re: Parallelize correlated subqueries that execute within each worker

From: James Coleman <jtc331(at)gmail(dot)com>
To: Michael Paquier <michael(at)paquier(dot)xyz>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Subject: Re: Parallelize correlated subqueries that execute within each worker
Date: 2022-01-14 19:15:40
Message-ID: CAAaqYe9NJzcrvVtr8n5WQ8wz=7imJ7xb36di-T5HHK02G7k4jQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Dec 3, 2021 at 2:35 AM Michael Paquier <michael(at)paquier(dot)xyz> wrote:
>
> On Mon, Nov 15, 2021 at 10:01:37AM -0500, Robert Haas wrote:
> > On Wed, Nov 3, 2021 at 1:34 PM James Coleman <jtc331(at)gmail(dot)com> wrote:
> >> As I understand the current code, parallel plans are largely chosen
> >> based not on where it's safe to insert a Gather node but rather by
> >> determining if a given path is parallel safe. Through that lens params
> >> are a bit of an odd man out -- they aren't inherently unsafe in the
> >> way a parallel-unsafe function is, but they can only be used in
> >> parallel plans under certain conditions (whether because of project
> >> policy, performance, or missing infrastructure).
> >
> > Right.
>
> Please note that the CF bot is complaining here, so I have moved this
> patch to the next CF, but changed the status as waiting on author.

I rebased this back in December, but somehow forgot to reply with the
updated patch, so, here it is finally.

Thanks,
James Coleman

Attachment Content-Type Size
v4-0001-Allow-parallel-LATERAL-subqueries-with-LIMIT-OFFS.patch application/octet-stream 3.5 KB
v4-0002-Parallel-query-support-for-basic-correlated-subqu.patch application/octet-stream 75.0 KB
v4-0003-Other-places-to-consider-for-completeness.patch application/octet-stream 5.1 KB

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Bossart, Nathan 2022-01-14 19:16:01 Re: O(n) tasks cause lengthy startups and checkpoints
Previous Message Teodor Sigaev 2022-01-14 18:47:04 Re: Pluggable toaster