Re: parallel quicksort

From: Markus Wanner <markus(at)bluegap(dot)ch>
To: Mark Wong <markwkm(at)gmail(dot)com>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: parallel quicksort
Date: 2010-08-09 07:28:52
Message-ID: 4C5FAE34.8010400@bluegap.ch
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi,

On 08/09/2010 12:04 AM, Mark Wong wrote:
> I've been playing around with a process based parallel quicksort
> (http://github.com/markwkm/quicksort) and I tried to shoehorn it into
> postgres because I wanted to see if I could sort more than integers.
> I've attached a patch that creates a new GUC to control the degree of
> parallelism and only modified the quicksort algorithm in quicksort.c.
> Trying to 'make install' quickly shows me the patch breaks zic and
> Andrew Gierth further pointed out on irc (a couple months back now)
> that user defined comparison functions won't work as expected in the
> forked processes (if I remember that correctly).

I'm not sure what the problems are, but the background worker
infrastructure I recently posted could possibly solve this problem, as
those are more like normal backends. (Assuming you were forking from the
backend).

> Hoping this could be useful, I wanted to put out what I had so far and
> see how far away this is from something workable. Not to mention that
> there are probably some improvements that could be make to the
> parallel quicksort algorithm.

Thanks for sharing.

Regards

Markus Wanner

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Joel Jacobson 2010-08-09 08:22:10 Re: pg_stat_transaction patch
Previous Message Pavel Stehule 2010-08-09 06:57:45 Re: review: psql: edit function, show function commands patch