Re: Creating many tables gets logical replication stuck

From: Achilleas Mantzios <achill(at)matrix(dot)gatewaynet(dot)com>
To: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: Creating many tables gets logical replication stuck
Date: 2020-08-25 12:44:49
Message-ID: 1459ef89-429f-59d8-725a-7fb6a0642a68@matrix.gatewaynet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hello Keisuke
On 25/8/20 9:50 π.μ., Keisuke Kuroda wrote:
> Hi All,
>
> There was a similar problem in this discussion:
> Logical decoding CPU-bound w/ large number of tables
> https://www.postgresql.org/message-id/flat/CAHoiPjzea6N0zuCi%3D%2Bf9v_j94nfsy6y8SU7-%3Dbp4%3D7qw6_i%3DRg%40mail.gmail.com
>
>> RelfilenodeMapHash from 1024 entries to 64.
> The above changes reduced the performance impact.
>
> However, I think the problem that there are too
> many invalidations of RelfilenodeMapHash still remains.
> As you report, when many tables are created/dropped/truncated,
Right! IIRC also a massive drop created the very same problem during the latest attempts for reproduction but I did not focus on this scenario.
> The walsender process can get stuck.
>

--
Achilleas Mantzios
IT DEV Lead
IT DEPT
Dynacom Tankers Mgmt

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Laurenz Albe 2020-08-25 12:50:45 Re: Creating many tables gets logical replication stuck
Previous Message Saha, Sushanta K 2020-08-25 12:18:08 Re: [E] Re: Most effective and fast way to load few Tbyte of data from flat files into postgresql