Re: hugepage configuration for V.9.4.0

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: John Scalia <jayknowsunix(at)gmail(dot)com>
Cc: "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org>
Subject: Re: hugepage configuration for V.9.4.0
Date: 2015-01-29 18:18:16
Message-ID: 11110.1422555496@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

John Scalia <jayknowsunix(at)gmail(dot)com> writes:
> I'm certain that I'm no expert for this one, as I've never had to configure this parameter for anything prior, but I continue to get a startup error when I try to use this. The
> server is a VM running CentOS 6.5 with 4 Gb allocated to it. When I started setting "huge_pages = on", the server reported:

> %FATAL: could not map anonymous shared memory: Cannot allocate memory
> %HINT: this error usually means that PostgreSQL's request for a shared memory segment exceeded available memory, swap space, or huge pages. To reduce the request size (currently
> 1124876288 bytes), reduce PostgreSQL's shared memory usage, perhaps by reducing shared_buffers or max_connections.

> Further research showed that server's /sys/kernel/mm/transparent_hugepage/enabled file contained "[always] madvise never"

> As I was concerned about the "always" setting, I used "cat madvise > " to the file so it reported "always [madvise] never" I even set this in /etc/rc.local and performed a reboot.

FWIW, I think that the transparent_hugepage setting is irrelevant to this.
The whole point here is that we're explicitly asking for a hugepage memory
segment, so the OS doesn't have to try to make it transparent.

What might be happening is that when requesting a hugepage segment, we
actually round up the request (here claimed to be 1124876288 bytes)
to the next 2MB boundary. Is it possible your kernel settings are
such that the slightly larger request fails?

Also, there may well be request limits that apply specifically to hugepage
segments; I don't know too much about that.

regards, tom lane

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message John Scalia 2015-01-29 18:37:00 Re: hugepage configuration for V.9.4.0
Previous Message Michael Heaney 2015-01-29 18:15:54 Re: hugepage configuration for V.9.4.0