Collect statistics about conflicts in logical replication

From: "Zhijie Hou (Fujitsu)" <houzj(dot)fnst(at)fujitsu(dot)com>
To: pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>
Cc: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, Peter Smith <smithpb2250(at)gmail(dot)com>, Peter Smith <smithpb2250(at)gmail(dot)com>, Nisha Moond <nisha(dot)moond412(at)gmail(dot)com>, "Hayato Kuroda (Fujitsu)" <kuroda(dot)hayato(at)fujitsu(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Collect statistics about conflicts in logical replication
Date: 2024-08-22 10:01:27
Message-ID: OS0PR01MB57160A07BD575773045FC214948F2@OS0PR01MB5716.jpnprd01.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi hackers,
Cc people involved in the related work.

In the original conflict resolution thread[1], we have decided to split the
conflict resolution work into multiple patches to facilitate incremental
progress towards supporting conflict resolution in logical replication, and one
of the work is statistics collection for the conflicts.

Following the discussions in the conflict resolution thread, the collection of
logical replication conflicts is important independently, which can help user
understand conflict stats (e.g., conflict rates) and potentially identify
portions of the application and other parts of the system to optimize. So, I am
starting a new thread for this feature.

The idea is to add columns(insert_exists_count, update_differ_count,
update_exists_count, update_missing_count, delete_differ_count,
delete_missing_count) in view pg_stat_subscription_stats to shows information
about the conflict which occur during the application of logical replication
changes. The conflict types originate from the committed work which is to
report additional information for each conflict in logical replication.

The patch for this feature is attached.

Suggestions and comments are highly appreciated.

[1] https://www.postgresql.org/message-id/CAA4eK1LgPyzPr_Vrvvr4syrde4hyT%3DQQnGjdRUNP-tz3eYa%3DGQ%40mail.gmail.com

Best Regards,
Hou Zhijie

Attachment Content-Type Size
v1-0001-Collect-statistics-about-conflicts-in-logical-rep.patch application/octet-stream 23.9 KB

Browse pgsql-hackers by date

  From Date Subject
Next Message Pavel Borisov 2024-08-22 10:02:21 Re: type cache cleanup improvements
Previous Message Alexander Lakhin 2024-08-22 09:00:00 RISC-V animals sporadically produce weird memory-related failures