Re: Batch replication ordering (was Re: [GENERAL] 32/64-bit

From: Jan Wieck <JanWieck(at)Yahoo(dot)com>
To: "Ed L(dot)" <pgsql(at)bluepolka(dot)net>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, pgsql-general(at)postgresql(dot)org, Steven Singer <ssinger(at)navtechinc(dot)com>
Subject: Re: Batch replication ordering (was Re: [GENERAL] 32/64-bit
Date: 2003-04-11 16:08:09
Message-ID: 3E96E869.58F9B428@Yahoo.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

"Ed L." wrote:
>
> On Friday April 11 2003 5:48, Jan Wieck wrote:
> > Tom Lane wrote:
> > > "Ed L." <pgsql(at)bluepolka(dot)net> writes:
> > > > I don't think so. Can you imagine a replication queue big enough to
> > > > that someone might not want to process it entirely in one
> > > > transaction?
> > >
> > > No, I can't. The bigger the queue is, the further behind you are, and
> > > the more you need to catch up; twiddling your thumbs for awhile gets
> > > progressively less attractive.
> >
> > That is absolutely sure in an asynchronous multi-master situation, where
> > "twiddling" only leads to conflicts ... not making your situation any
> > easier.
> >
> > But in a pure master slave situation? There I can imagine this.
>
> The context of my question is strictly master slave.
>
> > What I cannot imagine is why one would want to try to make batches any
> > other size than the original transaction. Committing smaller "chunks" of
> > the masters transactions at the slave side would allow a client there to
> > see an inconsistent snapshot - that is bad (tm). Committing bigger
> > groups contains the risk that the slave run's out of resources that the
> > master didn't need - not any better.
>
> To what slave resources are you referring?

Clearly a bug, but we had memory leaks that clear up at transaction end.

One of the "leaks" we still have: Constraint trigger queue.

Be sure, you don't want to find out that you have that kind of problem
by loosing slave by slave because your workload got worse ;-)

Jan

--
#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me. #
#================================================== JanWieck(at)Yahoo(dot)com #

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Ron Johnson 2003-04-11 16:21:16 Re: Key features for data warehousing
Previous Message Ed L. 2003-04-11 16:00:13 Re: Batch replication ordering (was Re: [GENERAL] 32/64-bit transaction IDs?)