pgsql: Implement partition-wise grouping/aggregation.

From: Robert Haas <rhaas(at)postgresql(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Implement partition-wise grouping/aggregation.
Date: 2018-03-22 16:58:01
Message-ID: E1ez3XN-0005Zc-12@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Implement partition-wise grouping/aggregation.

If the partition keys of input relation are part of the GROUP BY
clause, all the rows belonging to a given group come from a single
partition. This allows aggregation/grouping over a partitioned
relation to be broken down * into aggregation/grouping on each
partition. This should be no worse, and often better, than the normal
approach.

If the GROUP BY clause does not contain all the partition keys, we can
still perform partial aggregation for each partition and then finalize
aggregation after appending the partial results. This is less certain
to be a win, but it's still useful.

Jeevan Chalke, Ashutosh Bapat, Robert Haas. The larger patch series
of which this patch is a part was also reviewed and tested by Antonin
Houska, Rajkumar Raghuwanshi, David Rowley, Dilip Kumar, Konstantin
Knizhnik, Pascal Legrand, and Rafia Sabih.

Discussion: http://postgr.es/m/CAM2+6=V64_xhstVHie0Rz=KPEQnLJMZt_e314P0jaT_oJ9MR8A@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/e2f1eb0ee30d144628ab523432320f174a2c8966

Modified Files
--------------
doc/src/sgml/config.sgml | 20 +
src/backend/optimizer/README | 14 +
src/backend/optimizer/path/allpaths.c | 17 +-
src/backend/optimizer/path/costsize.c | 1 +
src/backend/optimizer/plan/createplan.c | 10 +-
src/backend/optimizer/plan/planner.c | 873 ++++++++++---
src/backend/utils/misc/guc.c | 9 +
src/backend/utils/misc/postgresql.conf.sample | 1 +
src/include/nodes/relation.h | 75 +-
src/include/optimizer/cost.h | 1 +
src/include/optimizer/paths.h | 2 +
src/test/regress/expected/partition_aggregate.out | 1393 +++++++++++++++++++++
src/test/regress/expected/sysviews.out | 37 +-
src/test/regress/parallel_schedule | 2 +-
src/test/regress/serial_schedule | 1 +
src/test/regress/sql/partition_aggregate.sql | 292 +++++
src/tools/pgindent/typedefs.list | 2 +
17 files changed, 2544 insertions(+), 206 deletions(-)

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message Tom Lane 2018-03-22 17:14:20 pgsql: Fix errors in contrib/bloom index build.
Previous Message Teodor Sigaev 2018-03-22 16:48:29 pgsql: Add conditional.c to libpgfeutils for MSVC build