Re: shared-buffers set to 24GB but the RAM only use 4-5 GB average

From: Merlin Moncure <mmoncure(at)gmail(dot)com>
To: FattahRozzaq <ssoorruu(at)gmail(dot)com>
Cc: postgres performance list <pgsql-performance(at)postgresql(dot)org>, Igor Neyman <ineyman(at)perceptron(dot)com>, Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>, Josh Berkus <josh(at)agliodbs(dot)com>
Subject: Re: shared-buffers set to 24GB but the RAM only use 4-5 GB average
Date: 2015-10-07 13:59:49
Message-ID: CAHyXU0w+tHLrmP0WvedWberukQ+ReYPAWwo3j-dJOyNrAGVSLQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Wed, Oct 7, 2015 at 5:29 AM, FattahRozzaq <ssoorruu(at)gmail(dot)com> wrote:
> Response from you all are very precious.
>
> @Merlin,
> I'm misunderstood the question.
> Yes, I didn't measure it. I only monitor RAM and CPU using htop (I also use

Can you be a little more specific. What values did you look at and
how did you sum them up? Assuming your measurement was correct, you
might be looking at simple prewarm issue in terms of getting shared
buffers stuffed up. There are some tactics to warm up shared buffers
(like pg_prewarm), but it's not clear that would be useful in your
case.

One cause (especially with older kernels) of low memory utilization is
misconfigured NUMA. Note this would only affect the backing o/s
cache, not pg's shared buffers.

Very first thing you need to figure out is if your measured issues are
coming from storage or not. iowait % above single digits suggests
this. With fast SSD it's pretty difficult to max out storage,
especially when reading data, but it's always the first thing to look
at. Context switch issues (as Scott notes) as another major
potential cause of performance variability, as is server internal
contention. But rule out storage first.

merlin

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Carlo 2015-10-07 23:40:31 Re: One long transaction or multiple short transactions?
Previous Message Scott Marlowe 2015-10-07 13:01:04 Re: shared-buffers set to 24GB but the RAM only use 4-5 GB average