Re: Thousands of schemas and ANALYZE goes out of memory

From: Jeff Janes <jeff(dot)janes(at)gmail(dot)com>
To: Hugo <hugo(dot)tech(at)gmail(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Thousands of schemas and ANALYZE goes out of memory
Date: 2012-10-04 19:56:47
Message-ID: CAMkU=1znQGQYG7mu4rKbhkk2R+OfXqjGK8Sm_N2Z+wAsGan51g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Thu, Oct 4, 2012 at 10:54 AM, Hugo <Nabble> <hugo(dot)tech(at)gmail(dot)com> wrote:
> We use Debian linux 32-bits, so the addressable space available really seems
> to be in the 3.0Gb to 3.5Gb range. Last night I decreased the shared_buffers
> from 2Gb to 1Gb and tried the global ANALYZE again. It went out of memory
> after 3 hours 40 minutes. That database has 12,197 schemas with 22 tables
> each, which means 268,334 tables. Should I keep reducing the shared_buffers
> and trying again? We don't plan to run the ANALYZE every week, so we can
> keep the shared_buffers high most of the time and tweak it when needed. I
> will try again tonight with ~512Mb and see what happens. Please let me know
> if you have ideas.

Your analyzes must be taking more memory than mine did, probably your
tables had indexes and my dummy ones did not. But you said you had
shell scripts to analyze table by table, and that seems like the
solution (until you can upgrade to 64-bit) as it is both faster and
more memory efficient to do it that way.

Cheers,

Jeff

In response to

Browse pgsql-general by date

  From Date Subject
Next Message serraios 2012-10-04 19:58:37 Re: Building an home computer for best Poker Tracker performance
Previous Message Tom Lane 2012-10-04 18:14:06 Re: Thousands of schemas and ANALYZE goes out of memory