Re: Test coverage for external sorting

From: Josh Berkus <josh(at)agliodbs(dot)com>
To: pgsql-hackers(at)postgresql(dot)org
Subject: Re: Test coverage for external sorting
Date: 2005-04-13 17:40:19
Message-ID: 200504131040.19179.josh@agliodbs.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Tom,

> BTW, as for your original question about performance, the current
> external sort algorithm is mainly designed to conserve disk space,
> not to be as fast as possible.  It could probably be a good bit faster
> if we didn't mind taking twice as much space (mainly because the
> physical disk access pattern would be a lot less random).  But I know
> we will get push-back if we try to revert to doing that.

We could do it as a compile-time option or a GUC. I know I wouldn't mind
taking extra disk space if my sorts ran faster on very large tables.
Currently, building a new btree index on a 100GB table takes about 2 hours on
a v40z. And that's not becuase of I/O; disk bandwidth is less than 20% used.

--
Josh Berkus
Aglio Database Solutions
San Francisco

Browse pgsql-hackers by date

  From Date Subject
Next Message Mark Wong 2005-04-13 18:11:41 PLM pulling from CVS nightly for testing in STP
Previous Message Thomas Hallgren 2005-04-13 17:15:39 Re: OUT parameters in PL/Java