varlena objects greater than 1GB

From: Michel Pelletier <pelletier(dot)michel(at)gmail(dot)com>
To: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: varlena objects greater than 1GB
Date: 2019-03-13 17:39:37
Message-ID: CACxu=v+S13EigQ1fSGtkxevhKyinfTtfWfMLwG2NpXoCOaExxg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hello,

I have read through this thread started by pg-strom's Kohei KaiGai:

https://www.postgresql.org/message-id/CADyhKSUP0PM6odyoV27q8CFG6mxMQFKY4R7XLz2NsXCHuwRZKA%40mail.gmail.com

and have a similar need to Kohei for varlena objects greater than 1GB, in
my case, also vector/matrix objects stored by the pggraphblas extension.

Thinking through my options, I was wondering if it would be a good idea to
use large object support to store matrix backing data, perhaps first as a
varlena object up to the limit, and then switch (in the flatten_into
function for my types) to an object storing the oid of the large object
holding the matrix data?

I'm going to experiment with this approach, but first wanted to raise the
issue to shoot some holes in first before trying it.

Thanks!

-Michel

Browse pgsql-general by date

  From Date Subject
Next Message Vijaykumar Jain 2019-03-13 18:35:02 Re: [External] Re: xmin and very high number of concurrent transactions
Previous Message Jamesie Pic 2019-03-13 17:32:52 Re: Where to store Blobs?