Re: pgBackRest for a 50 TB database

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Abhishek Bhola <abhishek(dot)bhola(at)japannext(dot)co(dot)jp>
Cc: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: pgBackRest for a 50 TB database
Date: 2023-10-03 13:39:36
Message-ID: CAOuzzgqiB9kNpzJNSP1LQpEjHV0A1tL-e+Qx7LB3jkufMPeX+w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Greetings,

On Mon, Oct 2, 2023 at 20:08 Abhishek Bhola <abhishek(dot)bhola(at)japannext(dot)co(dot)jp>
wrote:

> As said above, I tested pgBackRest on my bigger DB and here are the
> results.
> Server on which this is running has the following config:
> Architecture: x86_64
> CPU op-mode(s): 32-bit, 64-bit
> Byte Order: Little Endian
> CPU(s): 36
> On-line CPU(s) list: 0-35
> Thread(s) per core: 1
> Core(s) per socket: 18
> Socket(s): 2
> NUMA node(s): 2
>
> Data folder size: 52 TB (has some duplicate files since it is restored
> from tapes)
> Backup is being written on to DELL Storage, mounted on the server.
>
> pgbackrest.conf with following options enabled
> repo1-block=y
> repo1-bundle=y
> start-fast=y
>

Thanks for sharing! Did you perhaps consider using zstd for the
compression..? You might find that you get similar compression in less
time.

Thanks.

Stephen

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Douglas Reed 2023-10-03 14:37:18 Re: Problems starting slave
Previous Message Peter J. Holzer 2023-10-03 13:37:36 Re: Peer authentication failed ???