avoiding seq scans when two columns are very correlated

From: Ruslan Zakirov <ruz(at)bestpractical(dot)com>
To: pgsql-performance(at)postgresql(dot)org
Subject: avoiding seq scans when two columns are very correlated
Date: 2011-11-11 15:01:41
Message-ID: CAMOxC8vN4RzrzDEgWxXxdyfjCZfAzC8TbznakzmQE3q8=XL6sw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Hello,

A table has two columns id and EffectiveId. First is primary key.
EffectiveId is almost always equal to id (95%) unless records are
merged. Many queries have id = EffectiveId condition. Both columns are
very distinct and Pg reasonably decides that condition has very low
selectivity and picks sequence scan.

Simple perl script that demonstrates estimation error:
https://gist.github.com/1356744

Estimation is ~200 times off (5 vs 950), for real situation it's very
similar. Understandably difference depends on correlation coefficient.

In application such wrong estimation result in seq scan of this table
winning leading position in execution plans over other tables and
index scans.

What can I do to avoid this problem?

Tested with PostgreSQL 9.0.3 on x86_64-apple-darwin10.6.0, compiled by
GCC i686-apple-darwin10-gcc-4.2.1 (GCC) 4.2.1 (Apple Inc. build 5664),
64-bit

--
Best regards, Ruslan.

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2011-11-11 15:36:26 Re: avoiding seq scans when two columns are very correlated
Previous Message Rafael Martinez 2011-11-11 09:54:11 Re: WAL partition filling up after high WAL activity