Re: Mass-Data question

On Tue, 16 Apr 2002, [ISO-8859-15] Boris Kster wrote:

> Parallel querying sounds very interesting to me. My current plan was
> to do parallel writing because the hard-drives are not fast enough to
> collect all the data....

If it's really the hard drives that are not fast enough, you've
got a serious problem. The raw write speed of a hard drive is much,
much faster than Postgres.

But even so, it sounds like you have basically the same problem as
I do; how to get loads of data into the system really quickly.

> Normally it sounds not very complex to do parallelized
> reading/writing but getting the results in the right order that is a
> problem.

I don't see why. Just run the queries in parallel and merge the
results as they come in. Just make sure you use the same ORDER BY
on all the queries so you can do a merge sort.

cjs
--
Curt Sampson <cjs(at)cynic(dot)net> +81 90 7737 2974 http://www.netbsd.org
Don't you know, in this new Dark Age, we're all light. --XTC