Re: Truncate in synchronous logical replication failed

From: Petr Jelinek <petr(dot)jelinek(at)enterprisedb(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: "osumi(dot)takamichi(at)fujitsu(dot)com" <osumi(dot)takamichi(at)fujitsu(dot)com>, Peter Eisentraut <peter(dot)eisentraut(at)2ndquadrant(dot)com>, Japin Li <japinli(at)hotmail(dot)com>, "tanghy(dot)fnst(at)fujitsu(dot)com" <tanghy(dot)fnst(at)fujitsu(dot)com>, "pgsql-hackers(at)lists(dot)postgresql(dot)org" <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Truncate in synchronous logical replication failed
Date: 2021-04-13 14:37:47
Message-ID: 96122EFD-B14E-49C4-9A79-EB2C670FF28B@enterprisedb.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers


> On 12 Apr 2021, at 08:58, Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
>
> On Mon, Apr 12, 2021 at 10:03 AM osumi(dot)takamichi(at)fujitsu(dot)com
> <osumi(dot)takamichi(at)fujitsu(dot)com> wrote:
>>
>>> I checked the PG-DOC, found it says that “Replication of TRUNCATE
>>> commands is supported”[1], so maybe TRUNCATE is not supported in
>>> synchronous logical replication?
>>>
>>> If my understanding is right, maybe PG-DOC can be modified like this. Any
>>> thought?
>>> Replication of TRUNCATE commands is supported
>>> ->
>>> Replication of TRUNCATE commands is supported in asynchronous mode
>> I'm not sure if this becomes the final solution,
>>
>
> I think unless the solution is not possible or extremely complicated
> going via this route doesn't seem advisable.
>
>> but if we take a measure to fix the doc, we have to be careful for the description,
>> because when we remove the primary keys of 'test' tables on the scenario in [1], we don't have this issue.
>> It means TRUNCATE in synchronous logical replication is not always blocked.
>>
>
> The problem happens only when we try to fetch IDENTITY_KEY attributes
> because pgoutput uses RelationGetIndexAttrBitmap() to get that
> information which locks the required indexes. Now, because TRUNCATE
> has already acquired an exclusive lock on the index, it seems to
> create a sort of deadlock where the actual Truncate operation waits
> for logical replication of operation to complete and logical
> replication waits for actual Truncate operation to finish.
>
> Do we really need to use RelationGetIndexAttrBitmap() to build
> IDENTITY_KEY attributes? During decoding, we don't even lock the main
> relation, we just scan the system table and build that information
> using a historic snapshot. Can't we do something similar here?
>
> Adding Petr J. and Peter E. to know their views as this seems to be an
> old problem (since the decoding of Truncate operation is introduced).

We used RelationGetIndexAttrBitmap because it already existed, no other reason. I am not sure what exact locking we need but I would have guessed at least AccessShareLock would be needed.

--
Petr

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2021-04-13 14:45:28 Re: Old Postgresql version on i7-1165g7
Previous Message Dave Page 2021-04-13 14:33:23 More sepgsql weirdness