PgBackRest Full backup and N/W reliability

From: KK CHN <kkchn(dot)in(at)gmail(dot)com>
To: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: PgBackRest Full backup and N/W reliability
Date: 2024-08-29 06:21:54
Message-ID: CAKgGyB-bipQT+Mtyfv6xntS7w=_tp0sTeMkZLydMgzkC_6yvqg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

List,

I am doing a full backup using PgBackRest from a production server to
Reposerver.

My connection is IPSec VPN over ILL ( 8 Mbps link) between the
Production DB Server and the remote RepoServer.

I understood the bottleneck of 8 Mbps between servers. (Server NICs 10Gbps
and switch)

Query : I have started the backup command and it is running (may go for
hours and days as link speed is minimal) .
If the link disconnected or Network error happens before completion of the
backup command Definitely the option is to reissue the backup command
again.

If so, does the backup process start again from scratch ? or it resumes
from where the backup process is stopped ?

If it starts from scratch I am afraid that I can''t complete the initial
full backup never :(

Or is there a work around if the network connectivity is lost in between
?

Any suggestions much appreciated

Thank you ,
Krishane

[root(at)dbtest pgbackrest]# sudo -u postgres pgbackrest --stanza=Repo
--log-level-console=info backup

2024-08-29 10:55:27.729 P00 INFO: backup command begin 2.52.1: --delta
--exec-id=523103-56943986 --log-level-console=info --log-level-file=debug
--pg1-host=10.15.0.202 --pg1-host-user=enterprisedb
--pg1-path=/data/edb/as16/data --pg-version-force=16 --process-max=5
--repo1-block --repo1-bundle --repo1-cipher-pass=<redacted>
--repo1-cipher-type=aes-256-cbc --repo1-path=/data/DB_BKUPS
--repo1-retention-diff=2 --repo1-retention-full=2 --stanza=Repo --start-fast
WARN: no prior backup exists, incr backup has been changed to full
2024-08-29 10:55:30.589 P00 INFO: execute non-exclusive backup start:
backup begins after the requested immediate checkpoint completes
2024-08-29 10:55:31.543 P00 INFO: backup start archive =
00000001000000850000004C, lsn = 85/4C0007F8
2024-08-29 10:55:31.543 P00 INFO: check archive for prior segment
00000001000000850000004B

ON Repo Server:
[root(at)dbtest backup]# date
Thursday 29 August 2024 10:58:08 AM IST
[root(at)dbtest backup]# du -h
165M ./Repo
165M

[root(at)dbtest backup]# date
Thursday 29 August 2024 11:37:03 AM IST
[root(at)dbtest backup]# du -h
1.9G ./Repo
1.9G

ON Production Server /data/edb/as16/data directory size is 500 GB

Responses

Browse pgsql-general by date

  From Date Subject
Next Message David Rowley 2024-08-29 06:49:21 Re: Significant Execution Time Difference Between PG13.14 and PG16.4 for Query on information_schema Tables.
Previous Message KK CHN 2024-08-29 04:57:39 Re: PgbackRest : Stanza creation fails on DB Server and Repo Server