Initial Sync - One Subscriber After The Other vs. Parallel

From: Avi Weinberg <AviW(at)gilat(dot)com>
To: "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Initial Sync - One Subscriber After The Other vs. Parallel
Date: 2021-12-29 12:39:14
Message-ID: DB9PR07MB7180D880298666C510E9E0DACB449@DB9PR07MB7180.eurprd07.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi All

I'm testing logical replication and noticed that when I sync large tables to multiple subscribers, it is synchronizing two large tables out of 4 for subscriber A and then then two tables to subscriber B and continue to toggle between the two subscriptions.

It is possible to tell it to complete one subscription before starting the other?
What are the parameters that I can configure to increase the performance of sync and reduce its overall sync time, when one publisher is publishing to multiple subscriptions?

2021-12-29 02:46:06 UTC [1125]: [1-1] 61cbcbee.465 0 LOG: logical replication table synchronization worker for subscription "sub_dcn", table "packit3" has started
2021-12-29 02:46:06 UTC [1127]: [1-1] 61cbcbee.467 0 LOG: logical replication table synchronization worker for subscription "sub_dcn", table "packit4" has started
2021-12-29 02:46:17 UTC [1173]: [1-1] 61cbcbf9.495 0 LOG: logical replication table synchronization worker for subscription "sub_gwn", table "packit3" has started
2021-12-29 02:46:17 UTC [1175]: [1-1] 61cbcbf9.497 0 LOG: logical replication table synchronization worker for subscription "sub_gwn", table "packit4" has started
2021-12-29 02:48:52 UTC [1894]: [1-1] 61cbcc94.766 0 LOG: logical replication table synchronization worker for subscription "sub_dcn", table "packit2" has started
2021-12-29 02:51:49 UTC [3175]: [1-1] 61cbcd45.c67 0 LOG: logical replication table synchronization worker for subscription "sub_gwn", table "packit2" has started

2021-12-29 02:48:44 UTC [1127]: [2-1] 61cbcbee.467 0 LOG: logical replication table synchronization worker for subscription "sub_dcn", table "packit4" has finished
2021-12-29 02:48:47 UTC [1125]: [2-1] 61cbcbee.465 0 LOG: logical replication table synchronization worker for subscription "sub_dcn", table "packit3" has finished
2021-12-29 02:51:46 UTC [1175]: [2-1] 61cbcbf9.497 0 LOG: logical replication table synchronization worker for subscription "sub_gwn", table "packit4" has finished
2021-12-29 02:51:49 UTC [1173]: [2-1] 61cbcbf9.495 0 LOG: logical replication table synchronization worker for subscription "sub_gwn", table "packit3" has finished
2021-12-29 02:51:51 UTC [1894]: [2-1] 61cbcc94.766 0 LOG: logical replication table synchronization worker for subscription "sub_dcn", table "packit2" has finished
2021-12-29 02:54:30 UTC [3175]: [2-1] 61cbcd45.c67 0 LOG: logical replication table synchronization worker for subscription "sub_gwn", table "packit2" has finished

IMPORTANT - This email and any attachments is intended for the above named addressee(s), and may contain information which is confidential or privileged. If you are not the intended recipient, please inform the sender immediately and delete this email: you should not copy or use this e-mail for any purpose nor disclose its contents to any person.

Browse pgsql-general by date

  From Date Subject
Next Message john polo 2021-12-29 17:43:55 Find missing data in a column
Previous Message Narendra katlamudi 2021-12-29 08:31:32 Re: psql command failing with error "undefined symbol: PQhostaddr"