Re: Estimating HugePages Requirements?

From: Magnus Hagander <magnus(at)hagander(dot)net>
To: Julien Rouhaud <rjuju123(at)gmail(dot)com>
Cc: Don Seiler <don(at)seiler(dot)us>, pgsql-admin <pgsql-admin(at)postgresql(dot)org>
Subject: Re: Estimating HugePages Requirements?
Date: 2021-06-09 19:07:09
Message-ID: CABUevExXvoPvLN70CznmQfbjwxnrdXo9gXxZwGpBoUhjtFi3Ng@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin pgsql-hackers

On Wed, Jun 9, 2021 at 7:23 PM Julien Rouhaud <rjuju123(at)gmail(dot)com> wrote:
>
> On Thu, Jun 10, 2021 at 12:42 AM Don Seiler <don(at)seiler(dot)us> wrote:
> >
> > I'm told other factors contribute to this additional memory requirement, such as max_connections, wal_buffers, etc. I'm wondering if anyone has been able to come up with a reliable method for determining the HugePages requirements for a PG cluster based on the GUC values (that would be known at deployment time).
>
> It also depends on modules like pg_stat_statements and their own
> configuration. I think that you can find the required size that your
> current configuration will allocate with:
>
> SELECT sum(allocated_size) FROM pg_shmem_allocations ;

I wonder how hard it would be to for example expose that through a
commandline switch or tool.

The point being that in order to run the query you suggest, the server
must already be running. There is no way to use this to estimate the
size that you're going to need after changing the value of
shared_buffers, which is a very common scenario. (You can change it,
restart without using huge pages because it fails, run that query,
change huge pages, and restart again -- but that's not exactly...
convenient)

--
Magnus Hagander
Me: https://www.hagander.net/
Work: https://www.redpill-linpro.com/

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Tom Lane 2021-06-09 19:15:37 Re: Estimating HugePages Requirements?
Previous Message Bruce Momjian 2021-06-09 19:01:40 Re: Estimating HugePages Requirements?

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2021-06-09 19:07:48 Re: Add PortalDrop in exec_execute_message
Previous Message Bruce Momjian 2021-06-09 19:01:40 Re: Estimating HugePages Requirements?