| From: | "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com> |
|---|---|
| To: | Mark Kirkwood <mark(dot)kirkwood(at)catalyst(dot)net(dot)nz>, Bruce Momjian <bruce(at)momjian(dot)us>, Andres Freund <andres(at)anarazel(dot)de> |
| Cc: | Josh Berkus <josh(at)agliodbs(dot)com>, Robert Haas <robertmhaas(at)gmail(dot)com>, Mason S <masonlists(at)gmail(dot)com>, Oleg Bartunov <obartunov(at)gmail(dot)com>, Simon Riggs <simon(at)2ndquadrant(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: Horizontal scalability/sharding |
| Date: | 2015-09-01 15:20:12 |
| Message-ID: | 55E5C22C.6080107@commandprompt.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
On 09/01/2015 02:58 AM, Mark Kirkwood wrote:
> On 01/09/15 21:41, Bruce Momjian wrote:
> I'm thinking that partitioning and sharding are two different things:
>
> Partitioning is about reducing the amount of table data accessed and
> also perhaps easing admin activities (archiving/removing old stuff etc).
>
> Sharding is a about parallelism and redundancy...copies of stuff in
> different places and concurrent access by virtue of it being on
> different nodes!
In our world, they are complimentary. Consider partitioning that uses
FDW tables with proper plan push down etc....
>
> Now *maybe* FDW is a good way to approach this, but really would be nice
> to see a more rigorous analysis (I note that like XC and XL, Greenplum
> looked at the existing mechanisms around at the time and ended up
> writing their own). Now I'm aware that things have moved on - but I
> think there needs to be a proper discussion about design and what we
> think distributed data/sharding etc should provide *before* grabbing
> hold of FDW as *the answer*!
Agreed.
Sincerely,
Joshua D. Drake
--
Command Prompt, Inc. - http://www.commandprompt.com/ 503-667-4564
PostgreSQL Centered full stack support, consulting and development.
Announcing "I'm offended" is basically telling the world you can't
control your own emotions, so everyone else should do it for you.
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Shulgin, Oleksandr | 2015-09-01 15:20:42 | Re: On-demand running query plans using auto_explain and signals |
| Previous Message | Joshua D. Drake | 2015-09-01 15:18:38 | Re: Horizontal scalability/sharding |