Re: pgsql: Allow on-line enabling and disabling of data checksums

From: Andrew Dunstan <andrew(dot)dunstan(at)2ndquadrant(dot)com>
To: Magnus Hagander <magnus(at)hagander(dot)net>
Cc: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: Re: pgsql: Allow on-line enabling and disabling of data checksums
Date: 2018-04-06 00:03:31
Message-ID: CAA8=A7-A=J6cFvPoCShzorBmTF+0449Uj+shuK7C=+oiqiTxgA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

On Fri, Apr 6, 2018 at 5:35 AM, Magnus Hagander <magnus(at)hagander(dot)net> wrote:
> Allow on-line enabling and disabling of data checksums
>
> This makes it possible to turn checksums on in a live cluster, without
> the previous need for dump/reload or logical replication (and to turn it
> off).
>
> Enabling checkusm starts a background process in the form of a
> launcher/worker combination that goes through the entire database and
> recalculates checksums on each and every page. Only when all pages have
> been checksummed are they fully enabled in the cluster. Any failure of
> the process will revert to checksums off and the process has to be
> started.
>
> This adds a new WAL record that indicates the state of checksums, so
> the process works across replicated clusters.
>

This has broken the buildfarm's cross-version upgrade testing (yes, we
do it for same-version upgrade as well as previous version upgrade).

For now I have fixed crake by adding code to disable checksums in the
saved cluster. That at least will send crake green. Not sure if it's
the fix we want, though. Maybe we should test if checksums are enabled
on the upgraded cluster and if so enable them on the new cluster via
initdb. When we decide on the best fix I will put out a new release.

cheers

andrew

--
Andrew Dunstan https://www.2ndQuadrant.com
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services

In response to

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message Michael Paquier 2018-04-06 02:54:36 Re: pgsql: New files for MERGE
Previous Message Magnus Hagander 2018-04-05 20:40:21 pgsql: Attempt to fix win32 build of pg_verify_checksums