Re: PostgreSQL logical replication depends on WAL segments?

From: Josef Machytka <josef(dot)machytka(at)gmail(dot)com>
To: Jeremy Finzel <finzelj(at)gmail(dot)com>
Cc: Andres Freund <andres(at)anarazel(dot)de>, Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>, Postgres General <pgsql-general(at)postgresql(dot)org>
Subject: Re: PostgreSQL logical replication depends on WAL segments?
Date: 2019-01-23 08:50:43
Message-ID: CAGvVEFtkNJMRL8gUO3a_XTQs-EK=w6w8AXjY3gW3f6Q2KDf7+w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi guys, thank you very much for all information. I learned my lesson
regarding cronjob cleaning old WAL logs...

There is one other interesting problem I have found today and I would like
to ask you about you opinion.
On logical master I found this morning big flood of these messages in
postgresql log:

2019-01-23 08:17:42.338 UTC [1310] WARNING: oldest xmin is far in the past
2019-01-23 08:17:42.338 UTC [1310] HINT: Close open transactions soon to
avoid wraparound problems.
You might also need to commit or roll back old prepared
transactions, or drop stale replication slots.

Since this is still testing environment I dropped subscription and
publication and logical replication slot and messages stopped.
But do you know what was wrong? Why these warnings? Did logical replication
slot blocked autovacuum or something else happened?
Can I prevent it?
As mentioned before we have quite huge amount of data, around 500 millions
of records every day, most of them inserted in separate transactions or in
only small blocks so I guess xmin value can grow very quickly...

Thanks

jm

On Tue, 22 Jan 2019 at 20:03, Jeremy Finzel <finzelj(at)gmail(dot)com> wrote:

> Note replication slots only prevent old *catalog* rows from being
>> removed, not old row versions in user created tables.
>>
>
> Thank you for that clarification. I can see this is noted clearly in the
> CAUTION statement here:
> https://www.postgresql.org/docs/current/logicaldecoding-explanation.html#LOGICALDECODING-REPLICATION-SLOTS
>
> Thanks,
> Jeremy
>

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Alban Hertroys 2019-01-23 12:33:20 Reclaiming space for dropped database
Previous Message Achilleas Mantzios 2019-01-23 07:37:50 Re: PostgreSQL logical replication depends on WAL segments?