From: | Alexander Pyhalov <alp(at)sfedu(dot)ru> |
---|---|
To: | Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>, "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org> |
Subject: | RE: PostgreSQL memory usage |
Date: | 2019-10-17 12:29:04 |
Message-ID: | AM6PR05MB6198588E81ED27FE0C8A3396CF6D0@AM6PR05MB6198.eurprd05.prod.outlook.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
No, there are no long text or bytea fields, just int, bigint, ctime, limited varchar types.
However, one table has 2250 partitions and I've seen several selects to this table (based on the primary key of individual partitions) with a huge IN () list (about 500 keys). Don't expect this to be efficient, but unsure that these queries caused such memory consumption.
С уважением,
Александр Пыхалов,
программист отдела телекоммуникационной инфраструктуры
управления информационно-коммуникационной инфраструктуры ЮФУ
________________________________________
От: Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>
Отправлено: 17 октября 2019 г. 14:09
Кому: Alexander Pyhalov; pgsql-general(at)lists(dot)postgresql(dot)org
Тема: Re: PostgreSQL memory usage
Alexander Pyhalov wrote:
> After looking at my DBMS server for some time I've understood that I don't understand what was going on...
>
> A server has 48 GB RAM. shared_buffers is set to 12GB, work_mem - to 32MB, pgbouncer
> in transaction mode is used to connect pool (pool size 80) to PostgreSQL 10.5 server.
>
> I see that at some point several postgresql backends start consuming about 16 GB RAM.
> If we account for shared_buffers, it meens 4 GB RAM for private backend memory.
> How can we achieve such numbers? I don't see any long-running (or complex) queries
> (however, there could be long-running transactions and queries to large partitioned tables).
> But how could they consume 512* work_mem memory?
A wild guess: you are using large data items, or you have PostGIS installed,
which is known to use lots of memory for certain operations, which is not
limited by "work_mem".
Yours,
Laurenz Albe
--
Cybertec | https://www.cybertec-postgresql.com
From | Date | Subject | |
---|---|---|---|
Next Message | Tom Lane | 2019-10-17 12:40:15 | Re: PostgreSQL memory usage |
Previous Message | Laurenz Albe | 2019-10-17 11:25:36 | Re: A little confusion about JSON Path |