Re: Very bad FTS performance with the Polish config

From: Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>
To: Wojciech Knapik <webmaster(at)wolniartysci(dot)pl>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: Very bad FTS performance with the Polish config
Date: 2009-11-18 14:47:11
Message-ID: Pine.LNX.4.64.0911181738440.6801@sn.sai.msu.ru
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, 18 Nov 2009, Wojciech Knapik wrote:

>
>> your polish_english, polish configurations uses ispell language and slow,
>> while english configuration doesn't contains ispell. So, what's your
>> complains ? Try add ispell dictionary to english configuration and see
>> timings.
>
> Oh, so this is not anomalous ? These are the expected speeds for an ispell
> dictionary ? I didn't realize that. Sorry for the bother then. It just seemed
> way too slow to be practical.

You can see real timings using ts_lexize() function for different dictionaries
(try several time to avoid cold-start problem) instead of ts_headline(),
which involves other factors.

On my test machine I see no real difference between very simple dictionary
and french ispell, snowball dictionaries:

dev-oleg=# select ts_lexize('simple','voila');
ts_lexize
-----------
{voila}
(1 row)

Time: 0.282 ms
dev-oleg=# select ts_lexize('simple','voila');
ts_lexize
-----------
{voila}
(1 row)

Time: 0.269 ms

dev-oleg=# select ts_lexize('french_stem','voila');
ts_lexize
-----------
{voil}
(1 row)

Time: 0.187 ms

I see no big difference in ts_headline as well:

dev-oleg=# select ts_headline('english','I can do voila', 'voila'::tsquery);
ts_headline
-----------------------
I can do <b>voila</b>
(1 row)

Time: 0.265 ms
dev-oleg=# select ts_headline('nomaofr','I can do voila', 'voila'::tsquery);
ts_headline
-----------------------
I can do <b>voila</b>
(1 row)

Time: 0.299 ms

This is 8.4.1 version of PostgreSQL.

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru)
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message George Gensure 2009-11-18 14:57:07 Patch - Reference Function Parameters by Name
Previous Message Josh Berkus 2009-11-18 14:21:43 Re: operator exclusion constraints