Quick Links

Postgres Full Text Search Jsonb Array column does not search for first row

From:	Dmytro Zhluktenko <d1mnewz(at)gmail(dot)com>
To:	"pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject:	Postgres Full Text Search Jsonb Array column does not search for first row
Date:	2019-11-26 11:37:24
Message-ID:	5ddd0e76.1c69fb81.45d66.cc21@mx.google.com
Views:	Raw Message \| Whole Thread \| Download mbox \| Resend email
Thread:
Lists:	pgsql-general

<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style></style></head><body lang=UK><div class=WordSection1>Hey, <o:p></o:p><div style='margin-bottom:3.75pt;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch: inherit;box-sizing: inherit;overflow-wrap: break-word'>Pgsql is unable to perform indexed full text search onto jsonb column containing an array when looking for the first row in the table. Any ideas why this is happening?<o:p></o:p><p style='margin:0cm;margin-bottom:.0001pt;background:white;vertical-align:baseline;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch: inherit;line-height:inherit;box-sizing: inherit'>Table is nothing more than just <code>Id</code> and <code>Foo</code> which is <code>jsonb</code> column.<o:p></o:p><p style='margin:0cm;margin-bottom:.0001pt;background:white;vertical-align:baseline;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch: inherit;line-height:inherit;box-sizing: inherit'>The case is that I have an empty database with predefined gin index <code>repro_fts_idx</code> on <code>make_tsvector</code> function. <code>make_tsvector</code> creates <code>tsvector</code> from given <code>jsonb</code> column.<o:p></o:p><p style='margin:0cm;margin-bottom:.0001pt;background:white;vertical-align:baseline;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch: inherit;line-height:inherit;box-sizing: inherit'>When I add a new item into the table, I expect it to appear in <code>make_tsvector</code> function in a form of <code>tsvector</code>. It's there. Also, I expect that if I run full text search query onto it, it would appear in search results. However, this is not the case because it returns empty specifically for the first row. It simply does not take it into account. If I add one more row which is completely the same, the system is able to find it with the same query.<o:p></o:p><p style='mso-margin-top-alt:0cm;margin-right:0cm;margin-bottom:12.0pt;margin-left:0cm;background:white;vertical-align:baseline;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch: inherit;line-height:inherit;box-sizing: inherit'>here is a small repro case:<o:p></o:p><pre style='background:#EFF0F1;vertical-align:baseline;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch: inherit;line-height:inherit;box-sizing: inherit;max-height: 600px;border-radius: 3px;overflow-wrap: normal;overflow:auto'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>-- drop table cp."Repro" cascade<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>CREATE TABLE cp."Repro" (<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> "Id" serial NOT NULL,<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> "Foo" jsonb NULL<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>);<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>CREATE OR REPLACE FUNCTION cp.make_tsvector(in_t cp."Repro")<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> RETURNS tsvector<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> LANGUAGE plpgsql<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> IMMUTABLE<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>AS $function$ begin <o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> return to_tsvector(jsonb_agg(x.prop))<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> from (SELECT CONCAT( jsonb_array_elements(in_t."Foo") ->> 'Name', ' ', jsonb_array_elements(in_t."Foo") ->> 'Address' ) as prop from cp."Repro" f) as x;<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> END;<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> $function$<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>;<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>CREATE INDEX repro_fts_idx ON cp."Repro" USING gin (cp.make_tsvector(cp."Repro".*)) WITH (fastupdate=off, gin_pending_list_limit='64');<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>INSERT INTO cp."Repro"<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>("Foo")<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>VALUES('[{"Name": "Sup", "Address": "Adress", "IsCurrent": true}]');<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>-- just in case it's the indexing issue<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>-- REINDEX INDEX cp.repro_fts_idx;<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>select * from cp."Repro"<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>select cp.make_tsvector(x) from cp."Repro" x<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>select * from ts_stat('select cp.make_tsvector(x) from cp."Repro" x')<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>-- explain analyze<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>SELECT *<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> FROM "cp"."Repro" x where cp.make_tsvector(x) @@ 'sup:*'::tsquery<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> INSERT INTO cp."Repro"<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>("Foo")<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>VALUES('[{"Name": "Sup", "Address": "Adress", "IsCurrent": true}]');<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'><o:p> </o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>-- explain analyze<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'>SELECT *<o:p></o:p></pre><pre style='background:#EFF0F1;vertical-align:baseline'> FROM "cp"."Repro" x where cp.make_tsvector(x) @@ 'sup:*'::tsquery<o:p></o:p></pre></div><o:p> </o:p><o:p> </o:p>BR, Dmytro.<o:p></o:p><o:p> </o:p></div></body></html>

Attachment	Content-Type	Size
unknown_filename	text/html	53.3 KB

Responses

Re: Postgres Full Text Search Jsonb Array column does not search for first row at 2019-11-26 19:13:26 from Laurenz Albe

Browse pgsql-general by date

	From	Date	Subject
Next Message	Igor Neyman	2019-11-26 15:20:54	RE: Weird seqscan node plan
Previous Message	stan	2019-11-26 11:33:11	pgmodeler an server V12