Re: Re-partitioning huge schema

From: "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
To: Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
Cc: Erik Jones <erik(at)myemma(dot)com>, pgsql-general(at)postgresql(dot)org
Subject: Re: Re-partitioning huge schema
Date: 2007-12-07 20:44:02
Message-ID: 20071207124402.67ac705d@commandprompt.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Fri, 07 Dec 2007 12:53:45 -0500
Robert Treat <xzilla(at)users(dot)sourceforge(dot)net> wrote:

> On Wednesday 05 December 2007 17:29, Erik Jones wrote:
> > > i dont think you'll have much luck taking the "spread data evenly
> > > throught the
> > > partitions" approach; figure out how best to segment your data
> > > into manageable chunks. HTH.
> >
> > I agree. That's also why I'm not too worried about taking a bin
> > based approach to the partitioning. In addition, once this is done,
> > however I end up doing it, I'm going to be working on a horizontal
> > systems scaling approach wherein I set up another database,
> > replicate the global tables (all 132 of them) to it, and split the
> > accounts' userdata between the two databases -- fun, fun, fun!
> >
>
> A few of us have been playing with using plproxy in partitioning
> triggers to also achieve horizontal scaling at the same time, you
> might want to look into that. (Personally I've not yet landed a
> customer who needs such a solution, but hopefully soon)
>

I am in the process of a couple of prototype deployments for this. It
is very, very cool. I particularly like the ability to define which
nodes particular functions will be run on allowing you to have a
centralized master for your connect manager that can interact with any
number of various nodes based on function call.

Sincerely,

Joshua D. Drake

- --

=== The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 24x7/Emergency: +1.800.492.2240
PostgreSQL solutions since 1997 http://www.commandprompt.com/
UNIQUE NOT NULL
Donate to the PostgreSQL Project: http://www.postgresql.org/about/donate
PostgreSQL Replication: http://www.commandprompt.com/products/

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFHWbCVATb/zqfZUUQRAhcjAJ4sPDm1IwNMo5SyiQ4bod/XXwEomwCfcMZL
jGGjwJr/vZXgyZINY+GKMdQ=
=eGxt
-----END PGP SIGNATURE-----

In response to

Browse pgsql-general by date

  From Date Subject
Next Message John D. Burger 2007-12-07 21:12:30 Array index not used for query on first element?
Previous Message Pavel Stehule 2007-12-07 19:58:38 Re: Identifying casts