Re: Design question: Scalability and tens of thousands of tables?

From: Christopher Browne <cbbrowne(at)acm(dot)org>
To: pgsql-sql(at)postgresql(dot)org
Subject: Re: Design question: Scalability and tens of thousands of tables?
Date: 2005-11-04 23:59:08
Message-ID: m3mzkk7ynn.fsf@mobile.int.cbbrowne.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

> On Nov 4, 2005, at 9:47 AM, pgsql-sql-owner(at)postgresql(dot)org wrote:
>
>> The problem is I am very concerned about scalability with having a
>> different
>> table created for each custom object. I want to design to site to
>> handle
>> tens of thousands of users. If each user has 3-5 custom objects the
>> database would have to handle tens of thousands of tables.
>>
>> So it would appear that this is a broken solution and will not
>> scale. Has
>> anyone designed a similar system or have ideas to share?
>
> Well, before you discount it, did you try out your design? You could
> do initial segregation of user's tables into separate schemas (say,
> schema 'a' -> 'z' according to username or some better hashing
> routine like brute-force round-robin assignment at user creation
> time). Assignment of objects -> schema would be one additional column
> in your centralized user directory table(s).

I don't imagine this would help much with the *true* problem, which is
that a lot of queries inside the DB would have tens of thousands of
tables to go thru rather than (say) hundreds.

If you have 10,000 tables, that means 10,000 entries in pg_class.

Associating them with 26 (or 260) namespaces does nothing to assist
any queries that still have to scan through 10K pg_class entries.
--
(reverse (concatenate 'string "moc.liamg" "@" "enworbbc"))
http://linuxfinances.info/info/wp.html
"Whenever you find that you are on the side of the majority, it is
time to reform." -- Mark Twain

In response to

Browse pgsql-sql by date

  From Date Subject
Next Message Tai Huynh Phuoc 2005-11-05 05:12:54 can not connect to pg on linux FC4
Previous Message James Robinson 2005-11-04 15:11:36 Re: Design question: Scalability and tens of thousands of tables?