Re: Heavy Logging in Subscriber side when configured Logical Replication in 10.4

From: Achilleas Mantzios <achill(at)matrix(dot)gatewaynet(dot)com>
To: pgsql-admin(at)lists(dot)postgresql(dot)org
Subject: Re: Heavy Logging in Subscriber side when configured Logical Replication in 10.4
Date: 2018-09-03 07:13:47
Message-ID: 5b79452e-cec6-c93c-76de-968be43be45e@matrix.gatewaynet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

On 01/09/2018 11:56, pavan95 wrote:
> Hi Team,
>
> We have successfully configured and tested Logical Replication between
> Publisher and Subscriber. But on the Subscriber side we are getting
> generated a number of error log files(around 20-30 GB).
>
> The most common log messages found in the log(/var/log/postgresql/abc.log)
> are:
> 2018-08-26 06:32:09.659 IST [9385] ERROR: duplicate key value violates
> unique constraint "table_pkey"
> 2018-08-26 06:32:09.637 IST [13919] LOG: worker process: logical
> replication worker for subscription 4858103 sync 189974 (PID 9384) exited
> with exit code 1
> 2018-08-26 06:32:09.638 IST [13919] LOG: worker process: logical
> replication worker for subscription 4858103 sync 188985 (PID 9383) exited
> with exit code 1

This is severe and will eventually break your Publisher side too (the replication slot will grow forever).
So, you did something wrong, I hope - don't get me wrong I'd wish the same for myself :)
Either you created the subscription while the subscriber already had existing data in the tables, or you are inserting/updating dataI or Ds/keys on the subscriber that cause the problem .

>
>
> Some 72 lakh times the above errors are occurring. How to prevent this
> behaviour? Kindly assist me!!
>
> Thanks in Advance.
>
> Regards,
> Pavan
>
>
>
>
>
>
> --
> Sent from: http://www.postgresql-archive.org/PostgreSQL-admin-f2076596.html
>

--
Achilleas Mantzios
IT DEV Lead
IT DEPT
Dynacom Tankers Mgmt

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Andreas Kretschmer 2018-09-03 07:35:16 Re: trying to delete most of the table by range of date col
Previous Message Achilleas Mantzios 2018-09-03 07:09:08 Re: Heavy Logging in Subscriber side when configured Logical Replication in 10.4