Re: adding more space to the existing server

From: Julie Nishimura <juliezain(at)hotmail(dot)com>
To: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>, "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>, pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: adding more space to the existing server
Date: 2019-08-02 19:45:47
Message-ID: BYAPR08MB5014E634BC405CF9705BF37DACD90@BYAPR08MB5014.namprd08.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Thanks for your replies.

1) We use streaming replication, and due to hardware limitation, we cannot add more drives to the existing host. That is why we thought by breaking the existing streaming replication (from a->b), instead of currently identical standby (b), we can introduce twice larger host, then start the replication to the newly larger host, and when it is caught up, break it again. Then break rep again, make modification to 'a" host, making it larger, then replicate b->a. After it is caught up, break the rep again, switch master->standby (if necessary).

2) I am not sure about the time, but it is understood it is required 2 full replication cycles, and might be up to 2 weeks with no standby situation

3) Yes, we will clean up whatever we can to buy us time

4) by pg_basebackup and restore

As of now, we are thinking about possibly other solutions, as of splitting existing 37 databases on the cluster into 2 hosts with their own standbys. This solution requires breaking up existing replication as well. Can you please point me to some document which lists all steps describing breaking up the existing replication properly? we are using 9.6 postgres

Thank you!

________________________________
From: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
Sent: Thursday, August 1, 2019 7:28 AM
To: Julie Nishimura <juliezain(at)hotmail(dot)com>; pgsql-general(at)lists(dot)postgresql(dot)org <pgsql-general(at)lists(dot)postgresql(dot)org>; pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: adding more space to the existing server

On 7/31/19 3:21 PM, Julie Nishimura wrote:
> Hello postgres folks,
>
> We're tossing around the idea of upgrading a replicated postgres cluster
> (37 dbs) by breaking the replication, adding different size (larger)
> data disks to the hot-spare, then turning replication back on, letting
> it fully populate, then breaking replication, making the standby the
> primary, upgrade the disks on the other system, bring it back up,
> replicate backwards until fully replicated then failing-back to the
> original primary. Is this feasible?

To make a determination more information would be helpful:

1) What is the method of replication?

2) What is the expected downtime for the disk upgrades?

3) Dependent on 1). Is there sufficient storage to hold the data until
it can be replicated back?

4) How is the data on the existing disks going to get to the new disks?

>
> Our current size is 22 tb, and it is 97% full
> (PostgreSQL 9.6.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu
> 5.3.1-14ubuntu2) 5.3.1 20160413, 64-bit)
>
>
> Thank you for your suggestions

--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Andrew Gierth 2019-08-02 22:04:54 Re: SCRAM-SHA-256, is it possible to retrieve enough information from PG server (pg_authid etc) to perform authentication as a client
Previous Message Tom Lane 2019-08-02 13:53:22 Re: Altering multiple column types