Re: checkpoint process use too much memory

From: jian xu <jamesxu(at)outlook(dot)com>
To: MichaelDBA <MichaelDBA(at)sqlexec(dot)com>, Scott Ribe <scott_ribe(at)elevated-dev(dot)com>
Cc: Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>, "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org>
Subject: Re: checkpoint process use too much memory
Date: 2020-04-21 20:07:56
Message-ID: MN2PR05MB68327F7153695ED742BF1B19A1D50@MN2PR05MB6832.namprd05.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Good Point, Thanks Michael. Next time I will check the memory usage of other working processes.
looks like it is hard to troubleshooting the postgresql memory usage problem.
Some memory are shared, some are private, some are physical memory, some are virtual memory.
and the ps command shows the misleading memory usage of postgresql process,
is there any tool show memory usage for each postgresql process more clearly?
thanks,
James
________________________________
From: MichaelDBA <MichaelDBA(at)sqlexec(dot)com>
Sent: Monday, April 20, 2020 15:37
To: Scott Ribe <scott_ribe(at)elevated-dev(dot)com>
Cc: jian xu <jamesxu(at)outlook(dot)com>; Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>; pgsql-admin(at)postgresql(dot)org <pgsql-admin(at)postgresql(dot)org>
Subject: Re: checkpoint process use too much memory

You said: "the work_mem is 128MB, so they could use mostly 25GB memory,"

But work_mem is sometimes very deceiving based on types of queries executed. You may need many work_mem buffers for a single query. So 8 buffers used = 1GB. So it could conceivable surpass 25GB easily. I would do some explaining on your SQL workload.

Regards,
Michael Vitale

Scott Ribe wrote on 4/20/2020 3:23 PM:

On Apr 20, 2020, at 1:13 PM, jian xu <jamesxu(at)outlook(dot)com><mailto:jamesxu(at)outlook(dot)com> wrote:

Do you mean the file cache will be counted in postgres checkpointer memory usage?

No, it won't be counted as PG memory. I just mean that free memory low is not a sign of a problem, when it's file cache.

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Jesse Josserand 2020-04-21 23:40:02 Newbie needs help with space issue
Previous Message Laurenz Albe 2020-04-21 19:39:05 Re: checkpoint starting: time (insert statement hangs