Re: Cascading Replication

From: Asad Ali <asadalinagri(at)gmail(dot)com>
To: Ilian Kostadinov <ilian(dot)kostadinov(at)gmail(dot)com>
Cc: pgsql-admin(at)lists(dot)postgresql(dot)org
Subject: Re: Cascading Replication
Date: 2024-08-22 11:22:16
Message-ID: CAJ9xe=t_KzcuP8XDqGuDdbZGc9v1b07j1sy5K_OeS_QRG3FuDQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Hello *Ilian Kostadinov,*

Here’s how you can achieve this without needing to sync all data from the
beginning:

Make sure logical replication is enabled on Server B. In your
postgresql.conf, set the following parameters on Server B:

*wal_level = logicalmax_replication_slots = <desired number>max_wal_senders
= <desired number>*
Restart PostgreSQL on Server B for these changes to take effect.

On Server B, create a publication for the tables you want to replicate:

*CREATE PUBLICATION my_publication FOR ALL TABLES;*
If you need specific tables, adjust the query accordingly.

Create a logical replication slot on Server B. This slot will be used by
Server C to stream changes:

*SELECT * FROM pg_create_logical_replication_slot('my_slot', 'pgoutput');*
On Server C, create a subscription to the publication on Server B:

On Server C, create a subscription to the publication on Server B:

*CREATE SUBSCRIPTION my_subscription CONNECTION 'host=<Server B IP>
dbname=<dbname> user=<replication_user> password=<password>'PUBLICATION
my_publicationWITH (copy_data = false);*
The WITH (copy_data = false) clause is crucial because it prevents Server C
from copying all the data from scratch, which would be inefficient given
your 50TB database size. Instead, it will start replicating changes from
the point when the subscription is created.

Since you're skipping the initial data copy, you need to ensure that the
data on Server C is in sync with Server B. If Server C was already a
streaming replica of Server B, this should already be the case.
However, if any discrepancies exist, you may need to manually sync specific
tables or sequences.

Best Regards,
Asad Ali

On Tue, Aug 20, 2024 at 4:55 PM Ilian Kostadinov <ilian(dot)kostadinov(at)gmail(dot)com>
wrote:

> Hello,
>
> currently we have postgresql 16 with streaming replication. Is it possible
> to create logical replication of the streaming replica?
> So I have server A which is main database server with application
> connected to it.
> Also server B which is streaming replication of server A. I succeded to
> created server C
> which is streaming replica of server B, but I want to convert it to
> logical replica of server B.
> Database is more then 50TB, so how to convert server C to logical replica
> without need to sync all data from the beginning?
>
> Best Regards,
> Iliyan
>
>

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message rams nalabolu 2024-08-22 12:53:08 Re: Cascading Replication
Previous Message Ilian Kostadinov 2024-08-20 11:55:16 Cascading Replication