pgsql: Expression evaluation based aggregate transition invocation.

From: Andres Freund <andres(at)anarazel(dot)de>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Expression evaluation based aggregate transition invocation.
Date: 2018-01-09 21:48:14
Message-ID: E1eZ1kk-0001u1-Pi@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Expression evaluation based aggregate transition invocation.

Previously aggregate transition and combination functions were invoked
by special case code in nodeAgg.c, evaluating input and filters
separately using the expression evaluation machinery. That turns out
to not be great for performance for several reasons:

- repeated expression evaluations have some cost
- the transition functions invocations are poorly predicted, as
commonly there are multiple aggregates in a query, resulting in the
same call-stack invoking different functions.
- filter and input computation had to be done separately
- the special case code made it hard to implement JITing of the whole
transition function invocation

Address this by building one large expression that computes input,
evaluates filters, and invokes transition functions.

This leads to moderate speedups in queries bottlenecked by aggregate
computations, and enables large speedups for similar cases once JITing
is done.

There's potential for further improvement:
- It'd be nice if we could simplify the somewhat expensive
aggstate->all_pergroups lookups.
- right now there's still an advance_transition_function invocation in
nodeAgg.c, leading to some code duplication.

Author: Andres Freund
Discussion: https://postgr.es/m/20170901064131.tazjxwus3k2w3ybh@alap3.anarazel.de

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/69c3936a1499b772a749ae629fc59b2d72722332

Modified Files
--------------
src/backend/executor/execExpr.c | 429 ++++++++++++++++-
src/backend/executor/execExprInterp.c | 356 +++++++++++++-
src/backend/executor/nodeAgg.c | 864 ++++------------------------------
src/include/executor/execExpr.h | 76 ++-
src/include/executor/executor.h | 4 +-
src/include/executor/nodeAgg.h | 284 +++++++++++
src/include/nodes/execnodes.h | 5 +-
src/tools/pgindent/typedefs.list | 1 +
8 files changed, 1230 insertions(+), 789 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Bruce Momjian 2018-01-09 23:33:24 pgsql: Remove outdated/removed Win32 URLs in C comments
Previous Message Alvaro Herrera 2018-01-09 20:10:17 pgsql: Change some bogus PageGetLSN calls to BufferGetLSNAtomic