Re: Invalid memory alloc request size for repeat()

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Japin Li <japinli(at)hotmail(dot)com>
Cc: pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: Invalid memory alloc request size for repeat()
Date: 2022-05-27 05:03:04
Message-ID: 2537857.1653627784@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Japin Li <japinli(at)hotmail(dot)com> writes:
> Do those mean we cannot store 1GB to a field [1] and send 1GB of data to the client?

That's what I said upthread. I'm not terribly excited about that.
Shoving gigabyte-sized field values around as atomic strings is not
going to lead to anything but pain: even if the server can manage
it, clients will likely fall over. (Try a string a little smaller
than that, and notice how much psql sucks at handling it.)

There's been speculation from time to time about creating some
sort of streaming interface that would allow processing enormous
field values more reasonably. You can kinda-sorta do that now
with large objects, but those have enough other limitations and
issues that they're not very recommendable as a general solution.
Someone should try to develop a better version of that.

regards, tom lane

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Smith 2022-05-27 05:25:36 Re: Handle infinite recursion in logical replication setup
Previous Message Japin Li 2022-05-27 04:51:04 Re: Invalid memory alloc request size for repeat()