RE: [SQL] Query from multiple tables...

From: "Diehl, Jeffrey" <jdiehl(at)sandia(dot)gov>
To: "'Christopher Sawtell '" <csawtell(at)xtra(dot)co(dot)nz>, "Diehl, Jeffrey" <jdiehl(at)sandia(dot)gov>, "'pgsql-sql(at)postgresql(dot)org '" <pgsql-sql(at)postgresql(dot)org>, "'pgsql-general(at)postgresql(dot)org '" <pgsql-general(at)postgresql(dot)org>
Cc: "Diehl, Jeffrey" <jdiehl(at)sandia(dot)gov>
Subject: RE: [SQL] Query from multiple tables...
Date: 2001-01-17 07:41:26
Message-ID: B51F0C636E578A4E832D3958690CD73E0130BD9E@es04snlnt
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-sql

I wasn't splitting it up because I doubted postgres could handle the volume.
I verified that at the beginning of the project. I split the data up
because my database gets between 5 and 15 Million new records A DAY. We are
trying to keep about 45 days worth of data. Queries on such a volume are
extremely painfull. Keeping the data in one table simply isn't an option.

BTW, the system runs on a dual 733Mh PentiumIII with 1Gb of RAM. I'm using
8 18Gb SCSI drives at 10K RPM. Raid 5. I'm in the process of adding an
ADDITIONAL 8x36Gb RAID cabinet.

You don't have to tell me how well postgres scales. I've proven that. ;^)

Thanx for your time.
Mike Diehl.

-----Original Message-----
From: Christopher Sawtell
To: Diehl, Jeffrey; pgsql-sql(at)postgresql(dot)org; pgsql-general(at)postgresql(dot)org
Cc: Diehl, Jeffrey
Sent: 1/16/01 3:41 PM
Subject: Re: [SQL] Query from multiple tables...

On Wed, 17 Jan 2001 09:46, Diehl, Jeffrey wrote:
> Hi all,
>
> I have a database, that because of the size of the data, I have
separated
> on day's worth of data into it's own table.

postgreSQL will manage absolutely huge tables without problems.
( 2GB, & 4GB with that file size setting in the kernel )
Why do you have to cut the data into smaller tables?

> I have a separate table for
> each of, say, 30 days. I would like to write a query that will query
the
> last 15 days worth of tables. Can this be done?

No problem, if you leave the data in one table.

> I tried to use a view; that didn't work. I tried to use the union
clause;
> that didn't allow me to do group by...
>
> Is there a better way than to have my program rewrite the sql on the
fly?

you can issue queries direct from the shell script which would allow you
to
use shell variables to hold the date datum.

--
Sincerely etc.,

NAME Christopher Sawtell
CELL PHONE 021 257 4451
ICQ UIN 45863470
EMAIL csawtell @ xtra . co . nz
CNOTES
ftp://ftp.funet.fi/pub/languages/C/tutorials/sawtell_C.tar.gz

-->> Please refrain from using HTML or WORD attachments in e-mails to
me <<--

Browse pgsql-general by date

  From Date Subject
Next Message Alessio Bragadini 2001-01-17 07:53:35 Re: Slashdot and PostgreSQL
Previous Message Dan Wilson 2001-01-17 07:10:06 Re: Permissions

Browse pgsql-sql by date

  From Date Subject
Next Message Uwe Sander 2001-01-17 09:03:30 newby question
Previous Message Josh Berkus 2001-01-17 06:01:00 Re: Boolean and Bit