Logical Replication speed-up initial data

From: Nikhil Shetty <nikhil(dot)dba04(at)gmail(dot)com>
To: Pgsql Performance <pgsql-performance(at)lists(dot)postgresql(dot)org>
Subject: Logical Replication speed-up initial data
Date: 2021-08-04 15:06:46
Message-ID: CAFpL5VxhKgrdjT48sKSg_HJTeBp5PTmdYcjrYutdQd+ViFcR_Q@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Hi Team,

We have a highly transactional system as the source of logical replication
and the database size is 500GB+. We are replicating all tables from source
using logical replication.

For two tables the initial data load is very slow and it never completes
even after 24hrs+
Table size is under 100GB and index size is around 400GB.

How can we increase the speed of the initial data load without dropping the
indexes on destination?

We increased max_sync_workers_per_subscription to 3 but it didn't help much
for single tables

Thanks,
Nikhil

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Hüseyin Demir 2021-08-04 15:24:39 Re: Logical Replication speed-up initial data
Previous Message Daniel Westermann (DWE) 2021-07-30 11:15:19 Re: Performance issue with thousands of calls to procedures and functions?