parallelisation provides postgres performance (script example + ppt slides)

From: "Graeme B(dot) Bell" <graeme(dot)bell(at)nibio(dot)no>
To: "pgsql-performance(at)postgresql(dot)org list" <pgsql-performance(at)postgresql(dot)org>
Subject: parallelisation provides postgres performance (script example + ppt slides)
Date: 2015-07-23 13:45:54
Message-ID: 5DDC27B4-20CF-412F-B13F-FBFD3E522F9B@skogoglandskap.no
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance


Hi all,

1. For those that don't like par_psql (http://github.com/gbb/par_psql) here's an alternative approach that uses the Gnu Parallel command to organise parallelism for queries that take days to run usually. Short script and GIS-focused, but may give you a few ideas about how to parallelise your own code with Gnu Parallel.

https://github.com/gbb/fast_map_intersection

2. Also, I gave a talk at FOSS4G Como about these tools, and how to get better performance from your DB with parallelisation. May be helpful to people who are new to parallelisation / multi-core work with postgres.

http://graemebell.net/foss4gcomo.pdf

Graeme Bell.

p.s. (this version of the slides still has a few typos, which will be fixed soon when I get the source ppts back from my colleague's laptop).

Browse pgsql-performance by date

  From Date Subject
Next Message Laurent Debacker 2015-07-23 16:58:03 bitmap heap scan recheck for gin/fts with no lossy blocks
Previous Message Graeme B. Bell 2015-07-23 12:41:11 Re: hyperthreadin low performance (and some discussion about benchmarking)