Re: Improving pg_dump performance when handling large numbers of LOBs

From: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
To: Ron Johnson <ronljohnsonjr(at)gmail(dot)com>, "pgsql-generallists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Improving pg_dump performance when handling large numbers of LOBs
Date: 2024-02-05 19:53:27
Message-ID: 8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general


On 2/5/24 11:35 AM, Ron Johnson wrote:
> On Mon, Feb 5, 2024 at 2:01 PM Wyatt Tellis <wyatt(dot)tellis(at)gmail(dot)com>
> wrote:
>
> Hi,
>
> We've inherited a series of legacy PG 12 clusters that each
> contain a database that we need to migrate to a PG 15 cluster.
> Each database contains about 150 million large objects totaling
> about 250GB.
>
>
> 250*10^9 / (150*10^6) = 1667 bytes.  That's *tiny*.
>
> Am I misunderstanding you?

I think it less about the size of the individual objects then the number
(150 million) of them.

AFAIK that can't be handled by COPY, therefore they have to be
transferred individually.

--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Wyatt Tellis 2024-02-05 19:55:43 Re: Improving pg_dump performance when handling large numbers of LOBs
Previous Message Ron Johnson 2024-02-05 19:35:47 Re: Improving pg_dump performance when handling large numbers of LOBs