Re: [Postgres-xc-general] "Tuple not found error" during Index creation

From: Michael Paquier <michael(dot)paquier(at)gmail(dot)com>
To: Mason Sharp <msharp(at)translattice(dot)com>
Cc: Sandeep Gupta <gupta(dot)sandeep(at)gmail(dot)com>, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>, "<postgres-xc-general(at)lists(dot)sourceforge(dot)net>" <postgres-xc-general(at)lists(dot)sourceforge(dot)net>, John R Pierce <pierce(at)hogranch(dot)com>
Subject: Re: [Postgres-xc-general] "Tuple not found error" during Index creation
Date: 2013-12-11 03:22:57
Message-ID: CAB7nPqS+ATm0U-5Z024rqFFyPmh8zF=5cxmi8Z1r2u=SVHn5sA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Tue, Dec 10, 2013 at 11:00 PM, Mason Sharp <msharp(at)translattice(dot)com> wrote:
> In our StormDB fork (now TransLattice Storm) I made some changes to address
> some issues that were uncovered with XC. I am not sure if it will address
> this specific issue above, but in most cases we make it an error instead of
> falling back to a local XID like XC does (imagine if a node cannot reach GTM
> and autovacuum starts cleaning up data with local XIDs and snapshots) .
Yep, falling back to a local xid when GTM is not reachable has been
done since the beginning of the project. Considering that as a bug
using the argument that it endangers data visibility, such a patch
should be back-patched as well. Some insight on those remarks from the
core team would be welcome though.

> Also, we use GTM for getting XIDs for authentication and for autovacuum
> launcher because in concurrency testing not doing so results in the same XID
> being consumed by other sessions and causing hanging and other transaction
> problems. The bottom line is falling back to local XIDs and snapshots should
> almost always be avoided (initdb is ok).
Check.

> Our code is a bit different from vanilla XC, but I can try to put together a
> similar patch soon.
This would be welcome.

> As a community I feel we should prioritize more on testing and bug fixing
> like the reported issue and replicated table handling than on new features
> like the merged coordinator and datanode project.
Definitely, *normal* developers cannot afford spending so much time on
projects as big as that. One of the big things that I see missing is a
public instance of an XC buildfarm, by using for example the buildfarm
code of Postgres that simply fetches the code from git, and kicks
in-core tests. For XC this should be restricted though to regressions,
and compilation. pg_upgrade or isolation tests are not really
working...

Regards,
--
Michael

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Koichi Suzuki 2013-12-11 03:50:10 Re: [Postgres-xc-general] "Tuple not found error" during Index creation
Previous Message Tom Lane 2013-12-11 02:05:42 Re: Zero dead tuples, when significant apparent bloat