Re: Querying a Large Partitioned DB

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Apr 10, 2009, at 10:15 AM, Justin Funk wrote:

> Team Amazing,
>
> I am building a massive database for storing the syslogs of a room of
> servers. The database gets about 25 million entries a day, and need
> to keep
> them for 180 days. So the total size of the database will be about 4.5
> billion records.
>
> I need to be able to do full text searches on the message field, and
> of
> course, it needs to be reasonably fast.

You could use pg-pool II or your own middleware to execute the search
query in parallel across all the partitions (maybe not all 180 at
once, though).

Cheers,
M
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.10 (Darwin)

iEYEARECAAYFAknfaVAACgkQqVAj6JpR7t65DQCgsN51pMWoY8WXyxss6cXRPHug
4h8An2IufbKuhrw4fyki4gBbjrkkQD0M
=5PRb
-----END PGP SIGNATURE-----