Re: Running update in chunks?

From: Richard Huxton <dev(at)archonet(dot)com>
To: Tim Uckun <timuckun(at)gmail(dot)com>
Cc: Jeff Janes <jeff(dot)janes(at)gmail(dot)com>, Kevin Grittner <kgrittn(at)mail(dot)com>, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: Running update in chunks?
Date: 2013-01-25 09:23:07
Message-ID: 51024EFB.5080805@archonet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 25/01/13 08:57, Tim Uckun wrote:
>> What if you do:
>> alter table cars.imports set (fillfactor=50);
>> Before the vacuum full, and then try the update again?
>
> This makes a dramatic difference when combined with a vacuum.
>
> UPDATE 98834
> Time: 3408.210 ms
>
> Ten times faster!
That suggests (to me, at least) that it is related to index updating.
Again, your GIN index seems primary candidate.

A fillfactor of 50% means row updates probably stay on the same
disk-block as their previous version. This implies less index updates.

Try running iostat (I think that's available on a Mac) with/without the
fillfactor and with/without the GIN index while you do the updates. It's
possible your SSD is just behaving oddly under stress.

--
Richard Huxton
Archonet Ltd

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Jan Strube 2013-01-25 10:30:13 Prevent out of memory errors by reducing work_mem?
Previous Message Tim Uckun 2013-01-25 09:02:59 Re: Running update in chunks?