Re: IN list processing performance (yet again)

On Wed, May 28, 2003 at 16:13:17 -0400,
Dave Tenny <tenny(at)attbi(dot)com> wrote:
> Bruno Wolff III wrote:
>
> I assume you mean something like:
>
> test=# select million.id, million.val from million, (select 10000 as a
> union select 20000 as a) t2 where million.id = t2.a;
> id | val
> -------+-------
> 10000 | 0
> 20000 | 10000
> (2 rows)
>
> Ouch! That's deviant. Haven't tried it yet and I cringe at the
> thought of it, but I might take a run at it. However that's going to
> run up the buffer space quickly. That was one of my as yet unsnaswered
> questions, what is the pragmatic buffer size limit
> for queries?

That is what I was referring to. I have used this in some cases where
I knew the list was small and I wanted to do a set difference without
loading a temporary table. Or to do an insert of multiple rows with
one insert statement.

> I'm /really/ hoping we'll come up with something better, like an
> understanding of why IN lists are non-linear in the first
> place when the column is indexed, and whether it's fixable through some
> other means or whether it's a bug that should be fixed.

It also might be worth seeing if the development version is going to
speed things up for you. Beta is one month away. My guess is that the
production release will be in September.