Re: [GENERAL] 4B row limit for CLOB tables

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Matthew Kelly <mkelly(at)tripadvisor(dot)com>
Cc: José Luis Tallón <jltallon(at)adv-solutions(dot)net>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [GENERAL] 4B row limit for CLOB tables
Date: 2015-02-03 15:01:07
Message-ID: 2275.1422975667@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

Matthew Kelly <mkelly(at)tripadvisor(dot)com> writes:
> However, I do have active databases where the current oid is between 1 billion and 2 billion. They were last dump-restored for a hardware upgrade a couple years ago and were a bit more than half the size. I therefore can imagine that I have tables which are keyed by ~8,000,000 consecutive oids.

> I would argue that when it wraps there will be a single insert that will probably block for 2-5 minutes while it tries to accomplish ~8,000,000 index scans inside of GetNewOidWithIndex. Even partitioning doesnt protect you from this potential problem.

That may be a hazard, but ...

> That being said Id be perfectly happy merely giving each TOAST table its own sequence as that almost entire mitigates the risk of an unexpected lock up on reasonably sized tables/partitions, and provides a functional work around for those of us with larger than average installs.

... this "fix" would actually make things enormously worse. With the
single counter feeding all tables, you at least have a reasonable
probability that there are not enormously long runs of consecutive OIDs in
any one toast table. With a sequence per table, you are nearly guaranteed
that there are such runs, because inserts into other tables don't create a
break.

(This effect is also why you're wrong to claim that partitioning can't fix
it.)

regards, tom lane

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message David Steele 2015-02-03 15:50:28 Re: Fwd: [GENERAL] 4B row limit for CLOB tables
Previous Message José Luis Tallón 2015-02-03 15:01:05 Re: Fwd: [GENERAL] 4B row limit for CLOB tables

Browse pgsql-hackers by date

  From Date Subject
Next Message David Fetter 2015-02-03 15:04:03 Re: Release note bloat is getting out of hand
Previous Message José Luis Tallón 2015-02-03 15:01:05 Re: Fwd: [GENERAL] 4B row limit for CLOB tables