logical replication initial copy and WAL generation

From: Radoslav Nedyalkov <rnedyalkov(at)gmail(dot)com>
To: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: logical replication initial copy and WAL generation
Date: 2021-05-19 11:16:07
Message-ID: CANhtRiZkq+D5Wj+rnAapma1W2KPhFp24z8tpu=gYK4Est+PNgQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hello Forum,
I know it sounds weird but we have faced it a couple of times already and
have no idea.
We're trying to establish logical replication from RDS(10.9) to RDS(12.5).
We're adding tables to the publication one by one.
During the initial copy for some tables we experience huge WAL generation
on the source db.
From 0.5mb/s it jumps to 15MB/s.
This happens when a copy just started or in the middle or at the end.
WAL generation causes service statements to wait on WALWriteLock causing
high response time.

Any idea how the initial copy can cause WAL generation ?!

Thank you very much,

Rado

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Laurenz Albe 2021-05-19 12:56:36 Re: logical replication initial copy and WAL generation
Previous Message Magnus Hagander 2021-05-19 10:00:46 Re: Plan for exclusive backup method