Re: Parallel WAL Archival Options

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Nikhil Shetty <nikhil(dot)dba04(at)gmail(dot)com>
Cc: Pgsql-admin <pgsql-admin(at)lists(dot)postgresql(dot)org>
Subject: Re: Parallel WAL Archival Options
Date: 2023-08-07 14:42:31
Message-ID: ZNEC18tW/KAyYGlG@tamriel.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Greetings,

* Nikhil Shetty (nikhil(dot)dba04(at)gmail(dot)com) wrote:
> I would like to know which backup&restore tools will be better for
> scenarios where the database is generating around 400 WALs per minute.
>
> We are using wal-g but it is not able to keep pace with the wal generation.
> We increased the upload streams to 256 but no luck

pgbackrest also does parallel WAL archiving and is able to handle
large volumes of WAL and we'd love to hear how well it works for you.

Feel free to reach out via a github issue if you have trouble making it
able to keep up.

Do be sure to also test that you're able to actually perform restores in
whatever timeframe you expect to be able to with that kind of WAL
generation.

Thanks,

Stephen

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Nikhil Shetty 2023-08-08 14:43:02 Re: Parallel WAL Archival Options
Previous Message Stephen Frost 2023-08-07 14:28:39 Re: Archive cleanup