Re: simple update query too long

From: Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com>
To: F T <oukile(at)gmail(dot)com>
Cc: Merlin Moncure <mmoncure(at)gmail(dot)com>, tv(at)fuzzy(dot)cz, Guillaume Lelarge <guillaume(at)lelarge(dot)info>, pgsql-general(at)postgresql(dot)org
Subject: Re: simple update query too long
Date: 2011-05-13 07:13:16
Message-ID: BANLkTi==niBMJuOULvFK8aut754xH4WSZQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

2011/5/13 F T <oukile(at)gmail(dot)com>:
> Thanks for your ideas.
>
> I have rerun my tests and I agree with Merlin, PostgreSQL is not adapted at
> all to handle wide updates.
>
> Summary :
> The table contains 2 millions rows.
>
> Test 1 :
> UPDATE grille SET inter=0; -> It tooks 10 hours
>
> Test 2 :
> I remove the spatial Gist index, and the constraints : I just keep the
> primary key.
> UPDATE grille SET inter=0; -> it tooks 6 hours.
>
> This is better but it is still not acceptable.
>
> And if I run CREATE TABLE test AS SELECT * FROM grille, it only takes 11
> seconds, incredible...

This is problem of GiST index. CREATE TABLE AS SELECT doesn't create
any indexes.

Regards

Pavel Stehule

>
> Fabrice
>
>
>
>
>
> 2011/5/9 Merlin Moncure <mmoncure(at)gmail(dot)com>
>>
>> On Mon, May 9, 2011 at 10:29 AM,  <tv(at)fuzzy(dot)cz> wrote:
>> >> On 05/09/2011 04:39 PM, F T wrote:
>> >>> Hi list
>> >>>
>> >>> I use PostgreSQL 8.4.4. (with Postgis 1.4)
>> >>>
>> >>> I have a simple update query that takes hours to run.
>> >>> The table is rather big (2 millions records) but it takes more than 5
>> >>> hours
>> >>> to run !!
>> >>>
>> >>> The query is just :
>> >>> *UPDATE grille SET inter = 0*
>> >>>
>> >
>> >>> So any ideas why is it soo long???
>> >>>
>> >>
>> >> You've got three indexes, so you have the update on the table *and* the
>> >> three indexes. Moreover, one of your indexes is a GiST with some
>> >> PostGIS
>> >> geometry. It takes usuaully quite some (long) time to update such
>> >> index.
>> >
>> > That only holds if the index needs to be updated. He's updating a column
>> > that is not indexed, so with a bit of luck the HOT might kick in. In
>> > that
>> > case the table would not bloat, the indexes would not need to be updated
>> > (and would no bloat) etc.
>> >
>> > The question is whether HOT may work in this particular case.
>>
>> HOT unfortunately does not provide a whole lot of benefit for this
>> case. HOT like brief, small transactions to the in page cleanup work
>> can be done as early as possible.  The nature of postgres is such that
>> you want to do everything you can to avoid table wide updates (up to
>> and including building a new table instead).
>>
>> merlin
>
>

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Oleg Bartunov 2011-05-13 07:46:23 Re: simple update query too long
Previous Message F T 2011-05-13 07:07:56 Re: simple update query too long