Re: pg_basebackup is taking more time than expected

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Raghavendra Rao J S V <raghavendrajsv(at)gmail(dot)com>
Cc: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: pg_basebackup is taking more time than expected
Date: 2018-01-13 16:22:21
Message-ID: 20180113162221.GD2416@tamriel.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Greetings,

Please don't top-post on the PG mailing lists.

* Raghavendra Rao J S V (raghavendrajsv(at)gmail(dot)com) wrote:
> pg_basebackup utility depends on which are the parameters?

I'm not sure what you're asking here.

> Is there any possibility to run the pg_basebackup in multi thread?

No, not today. There's been discussion about making it multi-threaded
but I seriously doubt that'll happen for v11 at this point.

> To improve the speed of the backup of database using pg_basebackup utility
> we shutdown the database and started alone database services. Till that
> time other sevices won't run. We observed some improvement but any other
> things we need to perform to reduce the time taken by the pg_basebackup
> utility.

Sure, reducing the load of the system might make pg_basebackup a little
faster, but seems unlikely to help it a lot in this case, and it means
you have downtime which might not be ideal.

> We are using below command to take the backup of the database. Any
> improvements to reduce the time taken by backup statement.
>
> $PGHOME/bin/pg_basebackup -p 5433 -U postgres -P -v -x --format=tar --gzip
> --compress=6 --pgdata=- -D /opt/backup_db

Might be faster if you didn't compress it, but, of course, then you
wouldn't have a compressed backup.

This is exactly the kind of issue that lead to the development of
pgBackRest. Larger databases really do need multi-threaded backups and
there weren't any backup tools for PG which were multi-threaded when we
started. There's a few other options now, which is good, but
pg_basebackup isn't one of them.

Thanks!

Stephen

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Raghavendra Rao J S V 2018-01-13 16:32:47 Re: pg_basebackup is taking more time than expected
Previous Message Raghavendra Rao J S V 2018-01-13 16:07:42 Re: pg_basebackup is taking more time than expected