Re: [HACKERS] Broken select on regular expression !!!

From: Bruce Momjian <maillist(at)candle(dot)pha(dot)pa(dot)us>
To: t-ishii(at)sra(dot)co(dot)jp
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Constantin Teodorescu <teo(at)flex(dot)ro>, pgsql-hackers(at)postgreSQL(dot)org
Subject: Re: [HACKERS] Broken select on regular expression !!!
Date: 1999-05-21 03:21:50
Message-ID: 199905210321.XAA16218@candle.pha.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

> These all oddness are caused by the parser (makeIndexable). When
> makeIndexable sees ~* '^41|^des' , it tries to rewrite the target
> regexp so that an index can be used. The rewritten query might be
> something like:
>
> fld1 ~* '^41|^des' and fld1 >= '41|^' and fld1 <= '41|^\377'
>
> Apparently this is wrong. This is because makeIndexable does not
> understand '|' and '^' appearing in the middle of the regexp. On the
> other hand,
>
> >regression=> select * from regdemo where fld1 ~* '^des|^41';
> >regression=> select * from regdemo where fld1 ~* '^sou|^des';
>
> will work since makeIndexable gave up the optimization if the op is
> "~*" and a letter appearing right after '^' is *alphabet*.
>
> Note that:
>
> >regression=> select * from regdemo where fld1 ~ '^sou|^des';
>
> will not work because the op is *not* "~*".
>
> It seems that the only solution is checking '|' to see if it appears
> in the target regexp and giving up the optimization in that case.
>
> One might think that ~* '^41|^des' can be rewritten like:
>
> fld1 ~* '^41' or fld1 ~* '^des'
>
> For me this seems not to be a good idea. To accomplish this, we have
> to deeply parse the regexp (consider that we might have arbitrary
> complex regexps) and such kind thing is a job regexp() shoud
> do.

Again very clear, and caused by the indexing of regex's, as you suggest.
I can easily look for '|' in the string, and skip the optimization. Is
that the only special case I need to add?

--
Bruce Momjian | http://www.op.net/~candle
maillist(at)candle(dot)pha(dot)pa(dot)us | (610) 853-3000
+ If your life is a hard drive, | 830 Blythe Avenue
+ Christ can be your backup. | Drexel Hill, Pennsylvania 19026

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruce Momjian 1999-05-21 04:08:53 Re: [HACKERS] Broken select on regular expression !!!
Previous Message Tom Lane 1999-05-21 03:19:50 Re: [HACKERS] Broken select on regular expression !!!