Re: Out of Memory errors are frustrating as heck!

From: Merlin Moncure <mmoncure(at)gmail(dot)com>
To: Gunther <raj(at)gusw(dot)net>
Cc: postgres performance list <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Out of Memory errors are frustrating as heck!
Date: 2019-10-08 17:50:32
Message-ID: CAHyXU0zHmfMib+AZzAiRt=+XhgBvExizuZ_gK7L09mu6AjX8LQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Tue, Oct 8, 2019 at 12:44 PM Merlin Moncure <mmoncure(at)gmail(dot)com> wrote:
> On Sun, Apr 14, 2019 at 3:51 PM Gunther <raj(at)gusw(dot)net> wrote:
> >
> > For weeks now, I am banging my head at an "out of memory" situation. There is only one query I am running on an 8 GB system, whatever I try, I get knocked out on this out of memory. It is extremely impenetrable to understand and fix this error. I guess I could add a swap file, and then I would have to take the penalty of swapping. But how can I actually address an out of memory condition if the system doesn't tell me where it is happening?
> > We can't really see anything too worrisome. There is always lots of memory used by cache, which could have been mobilized. The only possible explanation I can think of is that in that moment of the crash the memory utilization suddenly skyrocketed in less than a second, so that the 2 second vmstat interval wouldn't show it??? Nah.
> >
> > I have already much reduced work_mem, which has helped in some other cases before. Now I am going to reduce the shared_buffers now, but that seems counter-intuitive because we are sitting on all that cache memory unused!
> >
> > Might this be a bug? It feels like a bug. It feels like those out of memory issues should be handled more gracefully (garbage collection attempt?) and that somehow there should be more information so the person can do anything about it.
>
> I kind of agree that nothing according to vmstat suggests you have a
> problem. One thing you left out is the precise mechanics of the
> failure; is the database getting nuked by the oom killer? Do you have
> the logs?

oops, I missed quite a bit of context upthread. sorry for repeat noise.

merlin

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Ogden Brash 2019-10-08 20:20:43 Modification of data in base folder and very large tables
Previous Message Merlin Moncure 2019-10-08 17:44:39 Re: Out of Memory errors are frustrating as heck!