xlog-cleanup problem

From: "Tom Fischer" <tom(at)timia(dot)de>
To: <pgsql-admin(at)postgresql(dot)org>
Subject: xlog-cleanup problem
Date: 2014-11-05 00:13:49
Message-ID: F592F2DDBBFE4EBD82C9B785F14B4BE5@mia
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Hello,

we have some problems with the xlog-directory (size 5 GB). When we take a backup from one of our databases (about 80 GB data) and use an own script called by recovery.conf it begins to start the consumation of the wal-files fetched from our nas at a rate of about 2 per second.

Postgres just will not clean up the xlog-directory in time, so it runs full and next essential wal-file file could not be copied.
So my script stops for 5 minutes and sometimes the xlog is cleaned up a bit (from 100% to 84%) and the game starts again, there also has been some kind of lock and nothing happened until I restarted the cluster. On a restart the directory is cleaned up and about one half of the 5 GB will become available.

Checkpoint_segments are set to 64, wal-file-size is 16 MB, so at about 300 wal-files the whole game is over even if there should never be more then 3 * 64 + xxx, what should be under 200.
Why do we get a lot more then 300 wal-files and what can we do against this, even 10 GB xlog-size is not enough to keep up some kind of balance.

With friendly regards
Tom Fischer

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message jayknowsunix 2014-11-05 02:02:52 Re: xlog-cleanup problem
Previous Message Davenport, Julie 2014-11-04 23:09:24 Re: WARNING: psql version 8.4, server version 9.2.