Re: On partitioning

From: Robert Haas <robertmhaas(at)gmail(dot)com>
To: Amit Langote <Langote_Amit_f8(at)lab(dot)ntt(dot)co(dot)jp>
Cc: Andres Freund <andres(at)2ndquadrant(dot)com>, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>, Bruce Momjian <bruce(at)momjian(dot)us>, Pg Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: On partitioning
Date: 2014-11-07 20:40:37
Message-ID: CA+TgmobN+DT_=hj3NkXZgSv157-W24YaZ50oFdRbhS493covzg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Thu, Nov 6, 2014 at 9:17 PM, Amit Langote
<Langote_Amit_f8(at)lab(dot)ntt(dot)co(dot)jp> wrote:
> I mentioned upthread about the possibility of resurrecting Itagaki-san's patch [1] to try to make things work in this direction. I would be willing to spend time on this. I see useful reviews of the patch by Robert [2], Simon [3] at the time but it wasn't pursued further. I think those reviews were valuable design input that IMHO would still be relevant. It seems the reviews suggested some significant changes to the design proposed. Off course, there are many other considerations discussed upthread that need to be addressed. Incorporating those changes and others, I think such an approach could be worthwhile.

I'd be in favor of that. I am not sure whether the code is close
enough to what we need to be really useful, but that's for you to
decide. In my view, the main problem we should be trying to solve
here is "avoid relying on constraint exclusion". In other words, the
syntax for adding a partition should put some metadata into the system
catalogs that lets us do partitioning pruning very very quickly,
without theorem-proving. For example, for list or range partitioning,
a list of partition bounds would be just right: you could
binary-search it. The same metadata should also be suitable for
routing inserts to the proper partition, and handling partition motion
when a tuple is updated.

Now there's other stuff we might very well want to do, but I think
making partition pruning and tuple routing fast would be a pretty big
win by itself.

--
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Robert Haas 2014-11-07 20:48:36 Re: Repeatable read and serializable transactions see data committed after tx start
Previous Message Robert Haas 2014-11-07 20:32:26 Re: Representing a SRF return column in catalogs