回复:SnapBuildSerialize function forgot pfree variable ondisk_c

From: 范孝剑(康贤) <funnyxj(dot)fxj(at)alibaba-inc(dot)com>
To: "Amit Kapila" <amit(dot)kapila16(at)gmail(dot)com>
Cc: "pgsql-bugs" <pgsql-bugs(at)lists(dot)postgresql(dot)org>
Subject: 回复:SnapBuildSerialize function forgot pfree variable ondisk_c
Date: 2020-11-13 06:06:20
Message-ID: e79d4b89-e28b-4edd-bb32-c21120325f33.funnyxj.fxj@alibaba-inc.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

If we create logical slot frequently, every time when creating a logical slot, it will generate a LogStandbySnapshot wal record.

Session A:
do language plpgsql $$
declare
v_text text := 'a';
begin
for i in 1..290000 loop
execute $_$select pg_create_logical_replication_slot('logical_slot4', 'test_decoding')$_$;
execute $_$select pg_drop_replication_slot('logical_slot4')$_$;
end loop;
exception when others then
raise notice 'execute failed.';
end;$$;

Session B:
pg_recvlogical -d postgres --start -S test -f test.log

------------------------------------------------------------------
发件人:Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
发送时间:2020年11月6日(星期五) 11:21
收件人:范孝剑(康贤) <funnyxj(dot)fxj(at)alibaba-inc(dot)com>
抄 送:pgsql-bugs <pgsql-bugs(at)lists(dot)postgresql(dot)org>
主 题:Re: SnapBuildSerialize function forgot pfree variable ondisk_c

On Thu, Nov 5, 2020 at 2:06 PM 范孝剑(康贤) <funnyxj(dot)fxj(at)alibaba-inc(dot)com> wrote:
>
> Hi all,
> When I tested logical decoding, I found that walsender process memory usage grow very high, by debugging, I found SnapBuildSerialize palloc memory for variable ondisk_c, but don't pfree it at last.
>

By looking at code, it is clear that it is good to free the memory
allocated for variable ondisk_c.

> So when master LogStandbySnapshot() too frequently, walsender memory will grow very high and OOM finally.
>

Is there any particular scenario where you are seeing this behavior?
Do you have any reproducible test case? Have you confirmed that after
freeing that memory your problem is solved? It is not clear to me why
other users of Logical Replication are not facing this issue?

--
With Regards,
Amit Kapila.

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message Tom Lane 2020-11-13 16:03:17 Re: BUG #16714: INSERT ON CONFLICT DO UPDATE fails to infer constraint if it's not at top-level partition
Previous Message PG Bug reporting form 2020-11-13 03:23:43 BUG #16714: INSERT ON CONFLICT DO UPDATE fails to infer constraint if it's not at top-level partition