Re: Parallel WAL Archival Options

From: Nikhil Shetty <nikhil(dot)dba04(at)gmail(dot)com>
To: Stephen Frost <sfrost(at)snowman(dot)net>
Cc: Pgsql-admin <pgsql-admin(at)lists(dot)postgresql(dot)org>
Subject: Re: Parallel WAL Archival Options
Date: 2023-08-08 14:43:02
Message-ID: CAFpL5VxaNyri4A9xGz2EVoGJpAsze_ucu-6=Xg_kxA6bm9fdjQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Thanks Stephen , I'll check it out.

On Mon, 7 Aug 2023 at 20:12, Stephen Frost <sfrost(at)snowman(dot)net> wrote:

> Greetings,
>
> * Nikhil Shetty (nikhil(dot)dba04(at)gmail(dot)com) wrote:
> > I would like to know which backup&restore tools will be better for
> > scenarios where the database is generating around 400 WALs per minute.
> >
> > We are using wal-g but it is not able to keep pace with the wal
> generation.
> > We increased the upload streams to 256 but no luck
>
> pgbackrest also does parallel WAL archiving and is able to handle
> large volumes of WAL and we'd love to hear how well it works for you.
>
> Feel free to reach out via a github issue if you have trouble making it
> able to keep up.
>
> Do be sure to also test that you're able to actually perform restores in
> whatever timeframe you expect to be able to with that kind of WAL
> generation.
>
> Thanks,
>
> Stephen
>

In response to

Browse pgsql-admin by date

  From Date Subject
Next Message Jerry Sievers 2023-08-08 22:47:27 ignore_system_indexes=on no help for missing/corrupt pg_class_oid_index?
Previous Message Stephen Frost 2023-08-07 14:42:31 Re: Parallel WAL Archival Options