building gist index on int[] field is terrible slow. Is it bug?

From: "Pavel Stehule" <pavel(dot)stehule(at)gmail(dot)com>
To: "PostgreSQL Hackers" <pgsql-hackers(at)postgresql(dot)org>, "Oleg Bartunov" <oleg(at)sai(dot)msu(dot)su>
Subject: building gist index on int[] field is terrible slow. Is it bug?
Date: 2007-08-16 18:10:45
Message-ID: 162867790708161110o10cb5cbbhb9d49f71f4ae32c5@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hello

I tested contrib package intarray and gist support from this package.
I was surpirised. Index building needed lot of time.

10K fields .. 106sec
20K f ..265 sec
30Kf .. 450 sec
50Kf .. 1283sec

building gin index for 50K fields needed 0.5sec

Regards
Pavel Stehule

sample of data:
pavel=# select * from test limit 10;
a
-----------------------
{4209,4207,4197,2066}
{4832,3004}
{4629}
{3243}
{4816}
{3726}
{4834}
{1459,3160,3984}
{4569}
{4164,1307,962,4482}
(10 rows)

pavel=# select version();
version
-------------------------------------------------------------------------------------------------------
PostgreSQL 8.3devel on i686-pc-linux-gnu, compiled by GCC gcc (GCC)
4.1.2 20070502 (Red Hat 4.1.2-12)
(1 row)

Time: 442,034 ms

pavel=# show maintenance_work_mem ;
maintenance_work_mem
----------------------
16MB
(1 row)

pavel=# set maintenance_work_mem to '300MB';
SET
Time: 0,230 ms
pavel=#
pavel=# CREATE index fooidx on test using gist(a gist__int_ops);
CREATE INDEX
Time: 1269276,866 ms

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Ron Mayer 2007-08-16 18:31:01 Re: default_text_search_config and expression indexes
Previous Message Josh Berkus 2007-08-16 18:10:27 Re: tsearch2 in PostgreSQL 8.3?