Re: Looking for ideas on how to speed up warehouse loading

From: "scott(dot)marlowe" <scott(dot)marlowe(at)ihs(dot)com>
To: Sean Shanny <shannyconsulting(at)earthlink(dot)net>
Cc: <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Looking for ideas on how to speed up warehouse loading
Date: 2004-04-23 16:25:01
Message-ID: Pine.LNX.4.33.0404231022440.26996-100000@css120.ihs.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance


On Thu, 22 Apr 2004, Sean Shanny wrote:

> I should have included this as well:
> fsync | on
> shared_buffers | 4000
> sort_mem | 64000

For purposes of loading only, you can try turning off fsync, assuming this
is a virgin load and you can just re-initdb should bad things happen (OS,
postgresql crash, power plug pulled, etc...)

Also increasing sort_mem and shared_buffers might help. Especially
sort_mem. But turn it back down to something reasonable after the import.

And turn fsync back on after the import too. Note you have to restart
postgresql to make fsync = off take effect.

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Josh Berkus 2004-04-23 16:42:48 Re: Help with performance problems
Previous Message Aaron Werman 2004-04-23 15:16:13 Re: Help with performance problems