pgsql: Add support for automatically updating Unicode derived files

From: Peter Eisentraut <peter(at)eisentraut(dot)org>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Add support for automatically updating Unicode derived files
Date: 2020-01-09 09:15:27
Message-ID: E1ipTuZ-0007rV-Um@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Add support for automatically updating Unicode derived files

We currently have several sets of files generated from data provided
by Unicode. These all have ad hoc rules and instructions for updating
when new Unicode versions appear, and it's not done consistently.

This patch centralizes and automates the process and makes it part of
the release checklist. The Unicode and CLDR versions are specified in
Makefile.global.in. There is a new make target "update-unicode" that
downloads all the relevant files and runs the generation script.

There is also a new script for generating the table of combining
characters for ucs_wcwidth(). That table is now in a separate include
file rather than hardcoded into the middle of other code. This is
based on the script that was used for generating
d8594d123c155aeecd47fc2450f62f5100b2fbf0, but the script itself wasn't
committed at that time.

Reviewed-by: John Naylor <john(dot)naylor(at)2ndquadrant(dot)com>
Discussion: https://www.postgresql.org/message-id/flat/c8d05f42-443e-6c23-819b-05b31759a37c(at)2ndquadrant(dot)com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/f85a485f89e2eb38499558c7489f108994410952

Modified Files
--------------
GNUmakefile.in | 4 +
contrib/unaccent/.gitignore | 3 +
contrib/unaccent/Makefile | 19 ++
contrib/unaccent/generate_unaccent_rules.py | 10 +-
src/Makefile.global.in | 18 +-
src/backend/utils/mb/Unicode/Makefile | 3 -
src/backend/utils/mb/wchar.c | 68 +-------
src/common/unicode/.gitignore | 2 +-
src/common/unicode/Makefile | 14 +-
src/common/unicode/README | 17 +-
.../unicode/generate-unicode_combining_table.pl | 52 ++++++
src/include/common/unicode_combining_table.h | 194 +++++++++++++++++++++
src/tools/RELEASE_CHANGES | 3 +
13 files changed, 313 insertions(+), 94 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Magnus Hagander 2020-01-09 09:50:16 pgsql: Clarify that pg_trgm is used in example
Previous Message Andrew Dunstan 2020-01-09 08:11:33 pgsql: Allow 'sslkey' and 'sslcert' in postgres_fdw user mappings