Re: Inconsistent performance with LIKE and bind variable on long-lived connection

From: Steven Grimm <sgrimm(at)thesegovia(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: Inconsistent performance with LIKE and bind variable on long-lived connection
Date: 2017-06-11 16:34:24
Message-ID: CAOFXwWVbUwptwXVDTMa6vXRmGfqBtfqCTHmmX+ua9R23rq2Hsw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Sun, Jun 11, 2017 at 8:21 AM, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:

> Yeah, I've been watching this thread and trying to figure out how to
> explain that part; I suspected a cause of this form but couldn't
> make that theory match the 9-iterations observation. (I still can't.)
>

I walked through the Java code in a debugger just now and have an
explanation for the 5 vs. 9 discrepancy. The JDBC driver keeps a cache of
queries that have been passed to a connection's prepareStatement() method,
and inlines the bind values the first 4 times it sees a query in the hopes
of reducing overhead on one-off queries. So I believe the sequence ends up
being:

1-4: JDBC driver inlines the values, server sees no bind variables
5: JDBC driver prepares the statement, server sees bind variables and tries
generic plan
6+: JDBC driver reuses the existing prepared statement from iteration 5
10: Server has seen the query 5 times before and switches to the custom plan

As for the broader problem, at the risk of being hopelessly naive about how
all this works internally: Could the discrepancy between the estimated and
actual row counts be tracked and fed back into the planner somehow?

-Steve

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Andre Mikulec 2017-06-11 16:57:10 trying to program in PostgreSQL C a statistics function
Previous Message Adrian Klaver 2017-06-11 15:57:51 Re: ERROR: unexpected chunk number 0 (expected 1) for toast value 76753264 in pg_toast_10920100