Re: WAL size many times data size?

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Craig James <cjames(at)emolecules(dot)com>
Cc: "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org>
Subject: Re: WAL size many times data size?
Date: 2016-11-10 14:57:57
Message-ID: 4751.1478789877@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Craig James <cjames(at)emolecules(dot)com> writes:
> Our streaming replication and WAL archiving keep having trouble because of
> the sheer size of the WAL files. The number of bytes in the WAL files seems
> to be a large multiplier, like 5x or 10x, the amount of data that we load.

My first instinct would be to check how often checkpoints are happening,
and increase the checkpoint control parameters so that they're at least
5 to 15 minutes apart. A short checkpoint interval leads directly to
WAL bloat because it means more full-page images get inserted into WAL.
(The first change of any given page after a checkpoint requires an FPI.)

regards, tom lane

In response to

Browse pgsql-admin by date

  From Date Subject
Next Message Poul Kristensen 2016-11-11 10:55:11 Postgresql 9.5 committing and log sequence number
Previous Message Ron Watkins 2016-11-10 14:37:25 Re: psql remote database access