Re: apply_scanjoin_target_to_paths and partitionwise join

From: Ashutosh Bapat <ashutosh(dot)bapat(dot)oss(at)gmail(dot)com>
To: Andrei Lepikhov <lepihov(at)gmail(dot)com>
Cc: Jakub Wartak <jakub(dot)wartak(at)enterprisedb(dot)com>, Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>, arne(dot)roland(at)malkut(dot)net, PostgreSQL Hackers <pgsql-hackers(at)lists(dot)postgresql(dot)org>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Julien Rouhaud <rjuju123(at)gmail(dot)com>, Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>, Richard Guo <guofenglinux(at)gmail(dot)com>
Subject: Re: apply_scanjoin_target_to_paths and partitionwise join
Date: 2025-01-02 09:41:33
Message-ID: CAExHW5sz+S3M6Jh0A57xrzmg5BGZw2EdPW6pny9reMUOyLDjmg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Tue, Oct 1, 2024 at 3:22 AM Andrei Lepikhov <lepihov(at)gmail(dot)com> wrote:
>
> On 24/7/2024 15:22, Ashutosh Bapat wrote:
> > On Wed, Jul 24, 2024 at 9:42 AM Richard Guo <guofenglinux(at)gmail(dot)com> wrote:
> >> Is there a specific query that demonstrates benefits from this change?
> >> I'm curious about scenarios where a partitionwise join runs slower
> >> than a non-partitionwise join.
> >
> > [1] provides a testcase where a nonpartitionwise join is better than
> > partitionwise join. This testcase is derived from a bug reported by an
> > EDB customer. [2] is another bug report on psql-bugs.
> I haven't passed through the patch yet, but can this issue affect the
> decision on what to push down to foreign servers: a whole join or just a
> scan of two partitions?
> If the patch is related to the pushdown decision, I'd say it is quite an
> annoying problem for me. From time to time, I see cases where JOIN
> produces more tuples than both partitions have in total - in this case,
> it would be better to transfer tables' tuples to the main instance
> before joining them.

Sorry for replying late. I somehow didn't notice this.

A join between partitions is pushed down if only partitionwise join is
chosen and a join between partitions won't be pushed down if
partitionwise join is not chosen. Hence this bug affects pushdown as
well.

The CF entry shows as waiting for author. But that isn't the right
status. Will change it to needs review. I think we need a consensus as
to whether we want to fix this bug or not. Since this bug doesn't
affect me anymore, I will just withdraw this CF entry if there is no
interest.

--
Best Wishes,
Ashutosh Bapat

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Eisentraut 2025-01-02 10:11:07 Re: [PoC] Federated Authn/z with OAUTHBEARER
Previous Message Richard Guo 2025-01-02 09:30:04 Re: ERROR: corrupt MVNDistinct entry