From: | nabble(dot)30(dot)miller_2555(at)spamgourmet(dot)com |
---|---|
To: | pgsql-general(at)postgresql(dot)org |
Subject: | Database storage |
Date: | 2009-07-09 23:40:59 |
Message-ID: | 1dd941090907091640s1f71655xbde1eb82f3d60d55@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
Hi -
I'm running Postgres v8.3 on Fedora 10 (home machine - x86_64
architecture). After realizing that the storage requirements of one of
my databases will exceed 4Tb, I wanted to see if anyone had any
suggestions as to hardware setup that works well with Postgres running
on Linux. I have partitioned most of the database, so older data can
go on slower devices with only 400-500Gb needed on faster devices.
Redundancy is a requirement. General database usage is generally low,
with burst input. For the curious, here's the general profile:
a) ~19,000,000 INSERT statements/ day (190 INSERTs/ commit blocks)
for a total of ~10 Gb INSERT/day
b) INSERTs occur sequentially (daily batch)
c) Handful of SELECT statements run per day to generate a few
dozen reports, but these are not resource-intensive.
d) Only 3-5 database users configured.
Initial thought: Use an external multi-bay eSATA case and inserting
some 7200RPM+, 32Mb cache 1T+ SATA drives running RAID 5.
A few specific questions:
1) Which components generally lead to bottlenecks (controller
card, individual HD cache, HD rotational speed, other???)
2) Are there better solutions (broad question in terms of price/
data availability)? Budget: $500 - $750 for the storage medium. Better
question: Which setup was worked well with a Postgres implementation
running on a similar budget?
3) If using a similar setup, are there any particular
implementation issues that are not relatively obvious?
Thanks for the input (even if not Postgres-specifc, I thought this
might be of interest to hobby database admins like myself running
Postgres implementations).
From | Date | Subject | |
---|---|---|---|
Next Message | Scott Marlowe | 2009-07-10 00:28:16 | Re: Database storage |
Previous Message | Tom Lane | 2009-07-09 21:18:10 | Re: Postgres 8.4 literal escaping |