Inappropriate inner table for nested loop join

From: Akihiko Odaki <akihiko(dot)odaki(dot)4i(at)stu(dot)hosei(dot)ac(dot)jp>
To: pgsql-performance(at)postgresql(dot)org
Subject: Inappropriate inner table for nested loop join
Date: 2017-06-23 10:31:40
Message-ID: 6a997766-470e-393e-3605-e55d2b41d1a9@stu.hosei.ac.jp
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Hi all,

I am having a problem with nested loop join.

A database has 2 tables: "posts" and "follows".
Table "posts" have two columns: "timestamp" and "account".
Table "follows" have two columns: "target_account" and "owner_account".
The database also has an index on "posts" ("account", "timestamp"), one
on "posts"("timestamp") and on "follows" ("owner_account",
"target_account").

Table "posts" is so big and have 10 million records.
The number of Records with the same value for "owner_accounts" in table
"follows" is about 100 by average.

I issue the following query:

SELECT "posts".*
FROM "posts"
JOIN "follows" ON "follows"."target_account" = "posts"."account"
WHERE "follows"."owner_account" = $1
ORDER BY "posts"."timestamp"
LIMIT 100

That results in a nested loop join with table "posts" as the inner and
"follows" as the outer, which queried for each loop. EXPlAIN ANALYZE
says the actual number of rows queried from table "posts" is 500,000.
This behavior is problematic.

For performance, it may be better to retrieve 100 records joined with a
record in table "follows", and then to retrieve those whose
"posts"."timestamp" is greater than the one of last record we already
have, or 100 records, joined with another record in table "follows", and
so on. It would end up querying 10,000 records from table "posts" at
most. The number could be even smaller in some cases.

Now I have these tough questions:
* Is the "ideal" operation I suggested possible for PostgreSQL?
* If so, I think that could be achieved by letting PostgreSQL use
"follows" as the inner in the loops. How could I achieve that?
* Is there any other way to improve the performance of the query?

Answers are greatly appreciated.

Regards,
Akihiko Odaki

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Albe Laurenz 2017-06-23 11:20:13 Re: Inappropriate inner table for nested loop join
Previous Message Glyn Astill 2017-06-23 07:52:59 Re: Dataset is fetched from cache but still takes same time to fetch records as first run