WAL archive cleanup om master

From: Martijn van Oosterhout <kleptog(at)svana(dot)org>
To: pgsql-general(at)postgresql(dot)org
Subject: WAL archive cleanup om master
Date: 2014-01-06 11:18:42
Message-ID: 20140106111842.GA23118@svana.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hoi,

I've setup a up WAL shipping configuration as described in the wiki. On
the master I have:

archive_mode = on
archive_command = 'cp %p /path_to/archive/%f'

and on the slave in the recovery.conf I have:

archive_cleanup_command = 'pg_archivecleanup /path/to/archive/ %r'
restore_command = 'cp /path/to/archive/%f %p'

In between the two machines I have an rsync process copying the files
from the master to the slave.

My problem is, that the archive_cleanup_command on the slave is
clearing old WAL files, which the rsync on the master just copies again
because they are still on the master.

I can make a script on the master that deletes files older than an
hour, but that will break horribly if the copying breaks for an hour.

Is there a smarter way to do this, like having rsync not copy stuff
already copied once?

Thanks in advance,
--
Martijn van Oosterhout <kleptog(at)svana(dot)org> http://svana.org/kleptog/
> He who writes carelessly confesses thereby at the very outset that he does
> not attach much importance to his own thoughts.
-- Arthur Schopenhauer

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Erik Darling 2014-01-06 12:55:55 Re: Dynamic SQL - transition from ms to pg
Previous Message Pavel Stehule 2014-01-06 08:25:02 Re: Dynamic SQL - transition from ms to pg