Re: [HACKERS] pg_dump and thousands of schemas

From: Claudio Freire <klaussfreire(at)gmail(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, Robert Klemme <shortcutter(at)googlemail(dot)com>, Tatsuo Ishii <ishii(at)postgresql(dot)org>, pgsql-performance(at)postgresql(dot)org, pgsql-hackers(at)postgresql(dot)org
Subject: Re: [HACKERS] pg_dump and thousands of schemas
Date: 2012-05-31 15:33:52
Message-ID: CAGTBQpZGTipeXBA50ppDp-1CFJFzWDr17mMit9EBJBKOYBGpWA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

On Thu, May 31, 2012 at 12:25 PM, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:
>> No, Tatsuo's patch attacks a phase dominated by latency in some
>> setups.
>
> No, it does not.  The reason it's a win is that it avoids the O(N^2)
> behavior in the server.  Whether the bandwidth savings is worth worrying
> about cannot be proven one way or the other as long as that elephant
> is in the room.
>
>                        regards, tom lane

I understand that, but if the locking is fixed and made to be O(N)
(and hence each table locking O(1)), then latency suddenly becomes the
dominating factor.

I'm thinking, though, pg_upgrade runs locally, contrary to pg_dump
backups, so in that case latency would be negligible and Tatsuo's
patch inconsequential.

I'm also thinking, whether the ResourceOwner patch you've proposed
would get negated by Tatsuo's patch, because suddenly a "portal"
(IIRC) has a lot more locks than ResourceOwner could accomodate,
forcing a reversal to O(N²) behavior. In that case, that patch would
in fact be detrimental... huh... way to go 180

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Geoghegan 2012-05-31 15:34:22 Re: Uh, I change my mind about commit_delay + commit_siblings (sort of)
Previous Message Peter Geoghegan 2012-05-31 15:26:48 Re: Uh, I change my mind about commit_delay + commit_siblings (sort of)

Browse pgsql-performance by date

  From Date Subject
Next Message Trevor Campbell 2012-05-31 22:29:47 Trouble with plan statistics for behaviour for query.
Previous Message Tom Lane 2012-05-31 15:25:37 Re: [HACKERS] pg_dump and thousands of schemas