Re: What's using all my RAM?

From: Scott Marlowe <smarlowe(at)g2switchworks(dot)com>
To: adey <adey11(at)gmail(dot)com>
Cc: "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org>, PostgreSQL Admin <postgres(at)productivitymedia(dot)com>, postgresql-l <postgresql-l(at)Groups(dot)ittoolbox(dot)com>
Subject: Re: What's using all my RAM?
Date: 2006-08-02 16:34:59
Message-ID: 1154536499.7882.51.camel@state.g2switchworks.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

On Tue, 2006-08-01 at 23:09, adey wrote:
> Please could someone tell me how to discover what is using all of my
> RAM?
> I am trying to run a vacuum against Postgres, but it fails immediately
> with:-
>
> "ERROR: out of memory
> DETAIL: Failed on request of size 1073741820."
>
> TOP shows the following:-
> Mem: 4077544k total, 3897868k used, 179676k free, 146960k
> buffers
> Swap: 2000084k total, 440k used, 1999644k free, 3352892k
> cached
> None of the listed processes appear to be using more than 1 or 2% MEM.

nothing is using your ram in the traditional sense.You're kernel is
caching files in the space that's not currently being used by
applications. note that you show 3897868k used, and 3352892k cached.
So, the actual memory being use by applications is the in use minus the
cached, or about 544,000k. The rest is actually available, and the
kernel will gladly give it back if a program needs it.

You actual problem here is that your machine is trying to allocate
approx 1 Gig at once. Large allocations tend to point towards some kind
of data corruption in your database, but not always.

Try a vacuuming each table one at a time to see which one is causing
this error (if it's not already in the error message and got edited
away.) See if a select of all rows on that table gets the same error
message.

> Postgres v7.4.2 (upgrade underway)

If you can get a clean backup, look into at least 8.0. There were huge
improvements from 7.4 to 8.0. 8.1 is even more impressive. (says the DBA
who's still running 7.4.13 on all his boxes... :)

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Aaron Bono 2006-08-02 17:43:01 Re: Controlling CPU Usage in PostgreSQL
Previous Message Bruce Momjian 2006-08-02 13:46:17 Re: On-line backup - /bin/tar: Error exit delayed from