Re: [HACKERS] path toward faster partition pruning

From: Ashutosh Bapat <ashutosh(dot)bapat(at)enterprisedb(dot)com>
To: Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>
Cc: Amit Langote <Langote_Amit_f8(at)lab(dot)ntt(dot)co(dot)jp>, David Rowley <david(dot)rowley(at)2ndquadrant(dot)com>, Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp>, Rajkumar Raghuwanshi <rajkumar(dot)raghuwanshi(at)enterprisedb(dot)com>, Robert Haas <robertmhaas(at)gmail(dot)com>, Dilip Kumar <dilipbalaut(at)gmail(dot)com>, Beena Emerson <memissemerson(at)gmail(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [HACKERS] path toward faster partition pruning
Date: 2018-01-04 14:29:30
Message-ID: CAFjFpRdO=PtzCtOAQkZ1QF-7NUHuT-kDLOb9-U3iWAug3FRkJA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Dec 29, 2017 at 6:32 PM, Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org> wrote:
> I happened to notice that Ashutosh's patch series at
> https://www.postgresql.org/message-id/CAFjFpReJhFSoy6DqH0ipFSHd=sLNEkSzAtz4VWCaS-w2jZL=uw@mail.gmail.com
> has a 0001 patch that modifies the partition_bound_cmp stuff too.
> Are those conflicting?
>
> Ashutosh's commit message:
> Modify bound comparision functions to accept members of PartitionKey
>
> Functions partition_bound_cmp(), partition_rbound_cmp() and
> partition_rbound_datum_cmp() are required to merge partition bounds
> from joining relations. While doing so, we do not have access to the
> PartitionKey of either relations. So, modify these functions to accept
> only required members of PartitionKey so that the functions can be
> reused for merging bounds.
>
> Amit's:
> Some interface changes for partition_bound_{cmp/bsearch}
>
> Introduces a notion of PartitionBoundCmpArg, which replaces the set
> of arguments void *probe and bool probe_is_bound of both
> partition_bound_cmp and partition_bound_bsearch. It wasn't possible
> before to specify the number of datums when a non-bound type of
> probe is passed. Slightly tweaking the existing interface to allow
> specifying the same seems awkward. So, instead encapsulate that
> into PartitionBoundCmpArg. Also, modify partition_rbound_datum_cmp
> to compare caller-specifed number of datums, instead of
> key->partnatts datums.
>

I haven't looked at Amit's changes, but we need a more flexible way to
pass information required for datum comparison than using
PartitionKey, since that's not available in the optimizer and can not
be associated with join, aggregate relations. If we pass that
information through a structure, there are two ways
1. it will need to be part of PartitionScheme; I am not sure if we can
have a substructure in PartitionKey. But if we can do it that way, we
can pass that structure to the functions.
2. we will need to construct the structure filling it with comparison
information and pass it to the comparison functions. I think what we
achieve out of this isn't worth the code we will need to add.

I would prefer first approach over the other.

--
Best Wishes,
Ashutosh Bapat
EnterpriseDB Corporation
The Postgres Database Company

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Alvaro Herrera 2018-01-04 14:30:10 Re: [HACKERS] Proposal: Local indexes for partitioned table
Previous Message Emre Hasegeli 2018-01-04 13:53:47 Re: [HACKERS] [PATCH] Improve geometric types