AW: BUG #18206: Strange performance behaviour depending on location of field in query.

From: Daniel Migowski <dmigowski(at)ikoffice(dot)de>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: "pgsql-bugs(at)lists(dot)postgresql(dot)org" <pgsql-bugs(at)lists(dot)postgresql(dot)org>
Subject: AW: BUG #18206: Strange performance behaviour depending on location of field in query.
Date: 2023-11-19 17:22:51
Message-ID: 41ED3F5450C90F4D8381BC4D8DF6BBDC0174014473@EXCHANGESERVER.ikoffice.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

Ah, ok, so it has to decode all the fields until the one needed is reached, because only be decoding one can find out the length of individual fields.

Sorry for the noise. But please have a look at my previous report, which is the really interesting one.

-----Ursprüngliche Nachricht-----
Von: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Gesendet: Sonntag, 19. November 2023 17:59
An: Daniel Migowski <dmigowski(at)ikoffice(dot)de>
Cc: pgsql-bugs(at)lists(dot)postgresql(dot)org
Betreff: Re: BUG #18206: Strange performance behaviour depending on location of field in query.

PG Bug reporting form <noreply(at)postgresql(dot)org> writes:
> I have a table with some columns id and a to z and these two queries
> have drastically different runtimes.

> select count(id) FROM testtable t WHERE t.z IS NULL; (35% slower
> than WHERE t.a IS NULL)
> select count(id) FROM testtable t WHERE t.a IS NULL;

> This just screems like somewhere PostgreSQL is iterating over fields
> over and over again without assigning field indexes to the literals.

This is entirely unsurprising. There's no cheap way to extract values from a row that contains nulls: the offset of the field you want can't be determined without iterating over all the fields before it, since some of them might not be there.

One could imagine ways to optimize queries of this exact form: if the WHERE clause is "WHERE t.z IS [NOT] NULL" and nothing else, in principle it could be checked by examining z's bit in the nulls bitmap, without really extracting any field values. But that'd require adding some remarkably ugly warts to the clause evaluation mechanism, and I doubt it would be worth the trouble.

regards, tom lane

In response to

Browse pgsql-bugs by date

  From Date Subject
Next Message Tom Lane 2023-11-19 19:08:05 Re: BUG #18205: Performance regression with NOT NULL checks.
Previous Message Tom Lane 2023-11-19 16:58:42 Re: BUG #18206: Strange performance behaviour depending on location of field in query.