Re: Skipping logical replication transactions on subscriber side

From: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
To: Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com>
Cc: Mark Dilger <mark(dot)dilger(at)enterprisedb(dot)com>, Greg Nancarrow <gregn4422(at)gmail(dot)com>, "tanghy(dot)fnst(at)fujitsu(dot)com" <tanghy(dot)fnst(at)fujitsu(dot)com>, "osumi(dot)takamichi(at)fujitsu(dot)com" <osumi(dot)takamichi(at)fujitsu(dot)com>, "houzj(dot)fnst(at)fujitsu(dot)com" <houzj(dot)fnst(at)fujitsu(dot)com>, Alexey Lesovsky <lesovsky(at)gmail(dot)com>, Peter Eisentraut <peter(dot)eisentraut(at)enterprisedb(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Skipping logical replication transactions on subscriber side
Date: 2021-09-27 03:45:53
Message-ID: CAA4eK1K0NS5daRBw_4KdxzOYi0FcxsYzt16gCiZuf7j=HzkiDA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Sep 24, 2021 at 7:01 AM Masahiko Sawada <sawada(dot)mshk(at)gmail(dot)com> wrote:
>
> On Fri, Sep 3, 2021 at 4:33 AM Mark Dilger <mark(dot)dilger(at)enterprisedb(dot)com> wrote:
>
> > I am attaching a version of such a function, plus some tests of your patch (since it does not appear to have any). Would you mind reviewing these and giving comments or including them in your next patch version?
> >
>
> I've looked at the patch and here are some comments:
>
> +
> +-- no errors should be reported
> +SELECT * FROM pg_stat_subscription_errors;
> +
>
> +
> +-- Test that the subscription errors view exists, and has the right columns
> +-- If we expected any rows to exist, we would need to filter out unstable
> +-- columns. But since there should be no errors, we just select them all.
> +select * from pg_stat_subscription_errors;
>
> The patch adds checks of pg_stat_subscription_errors in order to test
> if the subscription doesn't have any error. But since the subscription
> errors are updated in an asynchronous manner, we cannot say the
> subscription is working fine by checking the view only once.
>

One question I have here is, can we reliably write few tests just for
the new view patch? Right now, it has no test, having a few tests will
be better. Here, because the apply worker will keep on failing till we
stop it or resolve the conflict, can we rely on that fact? The idea
is that even if one of the entry is missed by stats collector, a new
one (probably the same one) will be issued and we can wait till we see
one error in view. We can add additional PostgresNode.pm
infrastructure once the main patch is committed.

--
With Regards,
Amit Kapila.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Masahiko Sawada 2021-09-27 03:50:39 Re: Skipping logical replication transactions on subscriber side
Previous Message David Rowley 2021-09-27 03:30:25 Re: Use simplehash.h instead of dynahash in SMgr