Re: postgresql.conf recommendations

From: Strahinja Kustudić <strahinjak(at)nordeus(dot)com>
To: Kevin Grittner <kgrittn(at)ymail(dot)com>
Cc: Johnny Tan <johnnydtan(at)gmail(dot)com>, "ac(at)hsk(dot)hk" <ac(at)hsk(dot)hk>, Josh Krupka <jkrupka(at)gmail(dot)com>, Alex Kahn <alex(at)paperlesspost(dot)com>, "pgsql-performance(at)postgresql(dot)org" <pgsql-performance(at)postgresql(dot)org>
Subject: Re: postgresql.conf recommendations
Date: 2013-02-07 12:06:53
Message-ID: CADKbJJUhe9_tXZ-UCGycDGjA6v42Go3sSgvXSmRvBMYA9N8hNQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

As others suggested having shared_buffers = 48GB is to large. You should
never need to go above 8GB. I have a similar server and mine has

shared_buffers = 8GB
checkpoint_completion_target = 0.9

This looks like a problem of dirty memory being flushed to the disk. You
should set your monitoring to monitor dirty memory from /proc/meminfo and
check if it has any correlation with the slowdowns. Also
vm.dirty_background_bytes should always be a fraction of vm.dirty_bytes,
since when there is more than vm.dirty_bytes bytes dirty it will stop all
writing to the disk until it flushes everything, while when it reaches the
vm.dirty_background_bytes it will slowly start flushing those pages to the
disk. As far as I remember vm.dirty_bytes should be configured to be a
little less than the cache size of your RAID controller, while
vm.dirty_background_bytes should be 4 times smaller.

Strahinja Kustudić | System Engineer | Nordeus

On Wed, Feb 6, 2013 at 10:12 PM, Kevin Grittner <kgrittn(at)ymail(dot)com> wrote:

> Johnny Tan <johnnydtan(at)gmail(dot)com> wrote:
>
> > Wouldn't this be controlled by our checkpoint settings, though?
>
> Spread checkpoints made the issue less severe, but on servers with
> a lot of RAM I've had to make the above changes (or even go lower
> with shared_buffers) to prevent a burst of writes from overwhelming
> the RAID controllers battery-backed cache. There may be other
> things which could cause these symptoms, so I'm not certain that
> this will help; but I have seen this as the cause and seen the
> suggested changes help.
>
> -Kevin
>
>
> --
> Sent via pgsql-performance mailing list (pgsql-performance(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-performance
>

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Charles Gomes 2013-02-07 14:41:46 Re: postgresql.conf recommendations
Previous Message Kevin Grittner 2013-02-06 21:12:50 Re: postgresql.conf recommendations