Re: is postgres a good solution for billion record data

From: Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
To: shahrzad khorrami <shahrzad(dot)khorrami(at)gmail(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: is postgres a good solution for billion record data
Date: 2009-10-24 20:43:11
Message-ID: dcc563d10910241343t5a570afbv78996e2a03939fdc@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Sat, Oct 24, 2009 at 7:32 AM, shahrzad khorrami
<shahrzad(dot)khorrami(at)gmail(dot)com> wrote:
> is postgres a good solution for billion record data, think of 300kb data
> insert into db at each minutes, I'm coding with php
> what do you recommend to manage these data?

You'll want a server with LOTS of hard drives spinning under it. Fast
RAID controller with battery backed RAM. Inserting the data is no
problem. 300kb a minute is nothing. My stats machine that handles
about 2.5M rows a day during the week is inserting in the megabytes
per second (it's also the search database so there's the indexer wtih
16 threads hitting it). The stats part of the load is miniscule until
you start retrieving large chunks of data, then it's mostly sequential
reads in the 100+Megs a second.

The more drives and the better the RAID controller you throw at the
problem the better performance you'll get. For the price of one
oracle license for one core, you can build a damned find pgsql server
or pair of servers.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Scott Marlowe 2009-10-24 20:53:23 Re: is postgres a good solution for billion record data
Previous Message Scott Marlowe 2009-10-24 20:34:56 Re: is postgres a good solution for billion record data.. what about mySQL?