From: | Alvaro Herrera <alvherre(at)2ndquadrant(dot)com> |
---|---|
To: | Andres Freund <andres(at)2ndquadrant(dot)com> |
Cc: | Robert Haas <robertmhaas(at)gmail(dot)com>, Bruce Momjian <bruce(at)momjian(dot)us>, Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>, Rajeev rastogi <rajeev(dot)rastogi(at)huawei(dot)com>, Ants Aasma <ants(at)cybertec(dot)at>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, Markus Wanner <markus(at)bluegap(dot)ch> |
Subject: | Re: Proposal for CSN based snapshots |
Date: | 2014-05-15 21:58:04 |
Message-ID: | 20140515215803.GC7857@eldon.alvh.no-ip.org |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
Andres Freund wrote:
> On 2014-05-15 17:37:14 -0400, Alvaro Herrera wrote:
> > Andres Freund wrote:
> > > On 2014-05-15 15:40:06 -0400, Robert Haas wrote:
> > > > On Thu, May 15, 2014 at 2:34 PM, Bruce Momjian <bruce(at)momjian(dot)us> wrote:
> >
> > > > If the larger clog size is a show-stopper (and I'm not sure I have an
> > > > intelligent opinion on that just yet), one way to get around the
> > > > problem would be to summarize CLOG entries after-the-fact. Once an
> > > > XID precedes the xmin of every snapshot, we don't need to know the
> > > > commit LSN any more. So we could read the old pg_clog files and write
> > > > new summary files. Since we don't need to care about subcommitted
> > > > transactions either, we could get by with just 1 bit per transaction,
> > > > 1 = committed, 0 = aborted. Once we've written and fsync'd the
> > > > summary files, we could throw away the original files. That might
> > > > leave us with a smaller pg_clog than what we have today.
> > >
> > > I think the easiest way for now would be to have pg_clog with the same
> > > format as today and a rangewise much smaller pg_csn storing the lsns
> > > that are needed. That'll leave us with pg_upgrade'ability without
> > > needing to rewrite pg_clog during the upgrade.
> >
> > Err, we're proposing a patch to add timestamps to each commit,
> > http://www.postgresql.org/message-id/20131022221600.GE4987@eldon.alvh.no-ip.org
> > which does so in precisely this way.
>
> I am not sure where my statements above conflict with committs?
I didn't say it did ...
--
Álvaro Herrera http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services
From | Date | Subject | |
---|---|---|---|
Next Message | Kohei KaiGai | 2014-05-15 22:03:49 | Re: sepgsql: label regression test failed |
Previous Message | Andres Freund | 2014-05-15 21:57:32 | Re: pg_recvlogical tests |