Re: Would it be possible to have parallel archiving?

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Andrey Borodin <x4mmm(at)yandex-team(dot)ru>
Cc: David Steele <david(at)pgmasters(dot)net>, hubert depesz lubaczewski <depesz(at)depesz(dot)com>, pgsql-hackers mailing list <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Would it be possible to have parallel archiving?
Date: 2018-08-28 20:41:28
Message-ID: 20180828204128.GJ3326@tamriel.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Greetings,

* Andrey Borodin (x4mmm(at)yandex-team(dot)ru) wrote:
> > 28 авг. 2018 г., в 17:07, Stephen Frost <sfrost(at)snowman(dot)net> написал(а):
> > I still don't think it's a good idea and I specifically recommend
> > against making changes to the archive status files- those are clearly
> > owned and managed by PG and should not be whacked around by external
> > processes.
> If you do not write to archive_status, you basically have two options:
> 1. On every archive_command recheck that archived file is identical to file that is already archived. This hurts performance.

It's absolutely important to make sure that the files PG is asking to
archive have actually been archived, yes.

> 2. Hope that files match. This does not add any safety compared to whacking archive_status. This approach is prone to core changes as writes are.

This blindly assumes that PG won't care about some other process
whacking around archive status files and I don't think that's a good
assumption to be operating under, and certainly not under the claim
that it's simply a 'performance' improvement.

> Well, PostgreSQL clearly have the problem which can be solved by good parallel archiving API. Anything else - is whacking around, just reading archive_status is nothing better that reading and writing.

Pushing files which are indicated by archive status as being ready is
absolutely an entirely different thing from whacking around the status
files themselves which PG is managing itself.

Thanks!

Stephen

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Jeremy Finzel 2018-08-28 20:46:43 Re: Some pgq table rewrite incompatibility with logical decoding?
Previous Message Andrey Borodin 2018-08-28 20:34:34 Re: Would it be possible to have parallel archiving?