pgsql: Fix decoding of MULTI_INSERTs when rows other than the last are

From: Andres Freund <andres(at)anarazel(dot)de>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Fix decoding of MULTI_INSERTs when rows other than the last are
Date: 2014-07-06 14:01:11
Message-ID: E1X3n0B-0000Ie-2J@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers pgsql-hackers

Fix decoding of MULTI_INSERTs when rows other than the last are toasted.

When decoding the results of a HEAP2_MULTI_INSERT (currently only
generated by COPY FROM) toast columns for all but the last tuple
weren't replaced by their actual contents before being handed to the
output plugin. The reassembled toast datums where disregarded after
every REORDER_BUFFER_CHANGE_(INSERT|UPDATE|DELETE) which is correct
for plain inserts, updates, deletes, but not multi inserts - there we
generate several REORDER_BUFFER_CHANGE_INSERTs for a single
xl_heap_multi_insert record.

To solve the problem add a clear_toast_afterwards boolean to
ReorderBufferChange's union member that's used by modifications. All
row changes but multi_inserts always set that to true, but
multi_insert sets it only for the last change generated.

Add a regression test covering decoding of multi_inserts - there was
none at all before.

Backpatch to 9.4 where logical decoding was introduced.

Bug found by Petr Jelinek.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/1b86c81d2d255d3fb665ddc77c2bc3dfd751a1df

Modified Files
--------------
contrib/test_decoding/expected/toast.out | 20 +++++++++++++++++++-
contrib/test_decoding/sql/toast.sql | 13 +++++++++++++
src/backend/replication/logical/decode.c | 10 ++++++++++
src/backend/replication/logical/reorderbuffer.c | 9 ++++++++-
src/include/replication/reorderbuffer.h | 4 ++++
5 files changed, 54 insertions(+), 2 deletions(-)

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message Andres Freund 2014-07-06 14:01:13 pgsql: Fix decoding of MULTI_INSERTs when rows other than the last are
Previous Message Noah Misch 2014-07-06 04:39:16 pgsql: Consistently pass an "unsigned char" to ctype.h functions.

Browse pgsql-hackers by date

  From Date Subject
Next Message Andres Freund 2014-07-06 14:11:19 Re: 9.4 logical replication - walsender keepalive replies
Previous Message Christoph Berg 2014-07-06 08:27:56 Re: postgresql.auto.conf and reload