Re: Query-plan for partitioned UPDATE/DELETE slow and swaps vmem compared to SELECT

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: John Papandriopoulos <dr(dot)jpap(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Query-plan for partitioned UPDATE/DELETE slow and swaps vmem compared to SELECT
Date: 2010-12-05 16:56:03
Message-ID: 26275.1291568163@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

John Papandriopoulos <dr(dot)jpap(at)gmail(dot)com> writes:
> On 12/4/10 2:40 PM, Tom Lane wrote:
>> [ pokes at that for a bit ... ] Ah, I had forgotten that UPDATE/DELETE
>> go through inheritance_planner() while SELECT doesn't. And
>> inheritance_planner() makes a copy of the querytree, including the
>> already-expanded range table, for each target relation. So the memory
>> usage is O(N^2) in the number of child tables.

> Thanks for the pointer to the code and explanation.

> In inheritance_planner(...) I see the memcpy of the input query tree, but for my example constraint exclusion would only result in one child being included. Or is the O(N^2) memory usage from elsewhere?

It's copying the whole range table, even though any one child query only
needs one of the child table entries. There might be some way to
finesse that, but it's not clear how else to end up with a final plan
tree in which each child table has the correct RT index number.

You could get rid of the memory growth, at the cost of a lot of
tree-copying, by doing each child plan step in a discardable memory
context. I'm not sure that'd be a win for normal sizes of inheritance
trees though --- you'd need to copy the querytree in and then copy the
resulting plantree out again, for each child. (Hm, but we're doing the
front-end copy already ...)

regards, tom lane

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2010-12-05 20:14:38 Re: Query-plan for partitioned UPDATE/DELETE slow and swaps vmem compared to SELECT
Previous Message John Papandriopoulos 2010-12-05 11:14:46 Re: Query-plan for partitioned UPDATE/DELETE slow and swaps vmem compared to SELECT