Re: How Big is Too Big for Tables?

From: Vick Khera <vivek(at)khera(dot)org>
To: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: How Big is Too Big for Tables?
Date: 2010-07-28 19:16:56
Message-ID: AANLkTinPFsu23rLFGonFkBhw7TGNKFiOOGhWLexgKkQ=@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Wed, Jul 28, 2010 at 3:05 PM, P Kishor <punk(dot)kish(at)gmail(dot)com> wrote:
> Keep in mind, the circa 100 million rows was for only part of the db.
> If I were to build the entire db, I would have about 4 billion rows
> for a year, if I were to partition the db by years. And, partitioning
> by days resulted in too many tables.
>

Don't partition by arbitrary slices. Find out what your queries are
and partition across the most common of those, possibly in two
dimensions even. Without knowing what kinds of queries you do it is
hard to suggest things that may actually benefit you. Are you using
one of the advanced data types in postgres that deals with spatial
data?

Additionally, if you're trying to have 4 billion rows of data and only
have a 12GB RAM on your box, no matter your choice of DB it will be
slow.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Brian Hirt 2010-07-28 19:45:37 Need help with full text index configuration
Previous Message Sandeep Srinivasa 2010-07-28 19:06:02 Re: Which CMS/Ecommerce/Shopping cart ?