Re: [GENERAL] CLOB & BLOB limitations in PostgreSQL

From: Bruce Momjian <bruce(at)momjian(dot)us>
To: Ivan Voras <ivoras(at)freebsd(dot)org>
Cc: PostgreSQL-development <pgsql-hackers(at)postgreSQL(dot)org>
Subject: Re: [GENERAL] CLOB & BLOB limitations in PostgreSQL
Date: 2014-04-15 00:51:31
Message-ID: 20140415005131.GB9043@momjian.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

On Mon, Apr 14, 2014 at 02:01:19PM +0200, Ivan Voras wrote:
> On 11/04/2014 16:45, Jack.O'Sullivan(at)tessella(dot)com wrote:
>
> > With point two, does this mean that any table with a bytea datatype is
> > limited to 4 billion rows (which would seem in conflict with the
> > "unlimited rows" shown by http://www.postgresql.org/about)? If we had
> > rows where the bytea was a "null" entry would they contribute towards
> > this total or is it 4 billion non-null entries?
>
> This seems strange. A core developer should confirm this but it doesn't
> make much sense - "bytea" fields are stored the same as "text" fields
> (including varchar etc), i.e. the "varlena" internal representation, so
> having the limit you are talking about would mean that any non-trivial
> table with long-ish text fields would be limited to 2^32 entries...

[ moved to hackers ]

Uh, I had not thought of this before but I think we need oids for toast
storage, which would explain this wiki text:

https://wiki.postgresql.org/wiki/BinaryFilesInDB

Storing binary data using bytea or text data types

Minus

bytea and text data type both use TOAST
limited to 1G per entry
--> 4 Billion entries per table

Is that correct?

--
Bruce Momjian <bruce(at)momjian(dot)us> http://momjian.us
EnterpriseDB http://enterprisedb.com

+ Everyone has their own god. +

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message David G Johnston 2014-04-15 01:31:14 Re: [GENERAL] CLOB & BLOB limitations in PostgreSQL
Previous Message Adrian Klaver 2014-04-15 00:48:11 Re: Unrecognized service

Browse pgsql-hackers by date

  From Date Subject
Next Message Kouhei Kaigai 2014-04-15 01:06:32 Re: Custom Scan APIs (Re: Custom Plan node)
Previous Message Peter Geoghegan 2014-04-15 00:45:56 Re: Clock sweep not caching enough B-Tree leaf pages?