Re: Full text search prefix matching

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Heikki Rauhala <heikki(dot)rauhala(at)reaktor(dot)fi>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Full text search prefix matching
Date: 2014-12-16 15:30:16
Message-ID: 1928.1418743816@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Heikki Rauhala <heikki(dot)rauhala(at)reaktor(dot)fi> writes:
> Should text search prefixes work predicatably as documented in [1] even if the lexemes are shorter than the query? How can I get it to work?

I believe what you're seeing can be explained by these observations:

regression=# select to_tsvector('finnish', 'sofia');
to_tsvector
-------------
'sof':1
(1 row)

regression=# select to_tsquery('finnish','sofia:*');
to_tsquery
------------
'sof':*
(1 row)

regression=# select to_tsquery('finnish','sofi:*');
to_tsquery
------------
'sofi':*
(1 row)

regression=# select to_tsquery('finnish','sof:*');
to_tsquery
------------
'sof':*
(1 row)

What this shows is that the finnish configuration includes a word-stemming
rule that strips off "ia". It won't strip off just "i" though, so "sofi"
doesn't get reduced to the same root and therefore doesn't match "sofia".
The "*" addition does nothing for you here since it allows matching in
the other direction (query shorter than target).

I know nothing of Finnish so I can't say just how correct these particular
stemming rules are for that language; perhaps they need adjustment. But
it seems to me that if you want blind non-language-aware prefix matching,
you probably don't want the full-text-search machinery at all. Full text
search is meant to deal with words, both in the documents and the queries.
You might take a look at pg_trgm as an alternative.

regards, tom lane

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Joseph Kregloh 2014-12-16 15:36:31 Re: Pausing log shipping for streaming replication
Previous Message Ramesh T 2014-12-16 15:29:33 pg_dump