From: | Atri Sharma <atri(dot)jiit(at)gmail(dot)com> |
---|---|
To: | David Rowley <dgrowleyml(at)gmail(dot)com> |
Cc: | Simon Riggs <simon(at)2ndquadrant(dot)com>, Robert Haas <robertmhaas(at)gmail(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org> |
Subject: | Re: using custom scan nodes to prototype parallel sequential scan |
Date: | 2014-11-12 08:34:48 |
Message-ID: | CAOeZVicxW7nzw=kRcSAGxLQ51aBemnU_hJDjBm-yx39g-=XKSg@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
On Wed, Nov 12, 2014 at 1:24 PM, David Rowley <dgrowleyml(at)gmail(dot)com> wrote:
>
> On Tue, Nov 11, 2014 at 9:29 PM, Simon Riggs <simon(at)2ndquadrant(dot)com>
> wrote:
>
>>
>> This plan type is widely used in reporting queries, so will hit the
>> mainline of BI applications and many Mat View creations.
>> This will allow SELECT count(*) FROM foo to go faster also.
>>
>>
> We'd also need to add some infrastructure to merge aggregate states
> together for this to work properly. This means that could also work for
> avg() and stddev etc. For max() and min() the merge functions would likely
> just be the same as the transition functions.
>
>
It might make sense to make a new planner operator which can be responsible
for pulling from each of the individual parallel Agg nodes and then
aggregating over the results.
A couple of things that might be worth considering are whether we want to
enforce using parallel aggregation or let planner decide if it wants to do
a parallel aggregate or go with a single plan. For eg, the average
estimated size of groups might be one thing that planner may consider while
deciding between a parallel and a single execution plan.
I dont see merging states as an easy problem, and should perhaps be tackled
apart from this thread.
Also, do we want to allow parallelism only with GroupAggs?
Regards,
Atri
From | Date | Subject | |
---|---|---|---|
Next Message | nill | 2014-11-12 08:44:36 | Reverse Engineering - search constraints are not explicitly stated in the tables from the VIEW |
Previous Message | Magnus Hagander | 2014-11-12 08:03:08 | Re: git.postgresql.org not finding a commit |