From: | Patrick Dung <patrick_dkt(at)yahoo(dot)com(dot)hk> |
---|---|
To: | "obartunov(at)gmail(dot)com" <obartunov(at)gmail(dot)com> |
Cc: | Pgsql-general General <pgsql-general(at)postgresql(dot)org> |
Subject: | Re: Find similar records (compare tsvectors) |
Date: | 2015-03-08 05:33:11 |
Message-ID: | 745779229.272087.1425792791661.JavaMail.yahoo@mail.yahoo.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
Thanks.
smlar is fast and quite good.I need find tuning on the search result.
On Saturday, March 7, 2015 12:07 AM, Oleg Bartunov <obartunov(at)gmail(dot)com> wrote:
On Fri, Mar 6, 2015 at 5:05 PM, Patrick Dung <patrick_dkt(at)yahoo(dot)com(dot)hk> wrote:
> Resend.
>
> How to quickly compare the similarity of two tsvector?
>
check http://www.sai.msu.su/~megera/postgres/talks/pgcon-2012.pdf
>
> On Monday, March 2, 2015 11:01 PM, Patrick Dung <patrick_dkt(at)yahoo(dot)com(dot)hk>
> wrote:
>
>
> Hello,
>
> I had a database with articles or attachment stored in bytea format.
> I also had a trigger: it insert/update the tsv column when a record is
> added/updated.
> The tsv column had a GIN index.
> With this setting, I can do very fast keyword search on the tsv.
>
> Suppose I had a specific record (id=100000).
> How to list similar records based on ranking?
> In that case, I had to compare a tsvector with another tsvector.
>
> I had this SQL which make the original tsv as a text and then to tsquery,
> Then I can compare a tsv and a tsquery.
> SELECT ts_rank(i.tsv, replace(strip(original.tsv)::text, ' ', '|')::tsquery)
> as similarity, i.company, i.industry, i.post_timestamp, i.id FROM items i,
> (SELECT tsv, id FROM items WHERE id=100000) AS original WHERE i.id !=
> original.id ORDER BY similarity;
>
> items table:
> id bigint
> company varchar
> industry varchar
> description varchar
> post_timestamp timestamp
> attachment bytea
> tsv tsvector
>
> The problem is that this is very slow.
> Any comment?
>
> Thank and regards,
> Patrick
>
>
From | Date | Subject | |
---|---|---|---|
Next Message | Nigel Gardiner | 2015-03-08 14:40:05 | Postgres and data warehouses |
Previous Message | dpopova | 2015-03-08 00:53:20 | Re: How to get plpython2 in /lib? |