Re: Hard limit on WAL space used (because PANIC sucks)

From: Jim Nasby <jim(at)nasby(dot)net>
To: Andres Freund <andres(at)2ndquadrant(dot)com>, Peter Geoghegan <pg(at)heroku(dot)com>
Cc: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Jeff Janes <jeff(dot)janes(at)gmail(dot)com>, Simon Riggs <simon(at)2ndquadrant(dot)com>, Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, Robert Haas <robertmhaas(at)gmail(dot)com>
Subject: Re: Hard limit on WAL space used (because PANIC sucks)
Date: 2014-01-23 00:19:25
Message-ID: 52E0600D.7040007@nasby.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 1/21/14, 6:46 PM, Andres Freund wrote:
> On 2014-01-21 16:34:45 -0800, Peter Geoghegan wrote:
>> >On Tue, Jan 21, 2014 at 3:43 PM, Andres Freund<andres(at)2ndquadrant(dot)com> wrote:
>>> > >I personally think this isn't worth complicating the code for.
>> >
>> >You're probably right. However, I don't see why the bar has to be very
>> >high when we're considering the trade-off between taking some
>> >emergency precaution against having a PANIC shutdown, and an assured
>> >PANIC shutdown
> Well, the problem is that the tradeoff would very likely include making
> already complex code even more complex. None of the proposals, even the
> one just decreasing the likelihood of a PANIC, like like they'd end up
> being simple implementation-wise.
> And that additional complexity would hurt robustness and prevent things
> I find much more important than this.

If we're not looking for perfection, what's wrong with Peter's idea of a ballast file? Presumably the check to see if that file still exists would be cheap so we can do that before entering the appropriate critical section.

There's still a small chance that we'd end up panicing, but it's better than today. I'd argue that even if it doesn't work for CoW filesystems it'd still be a win.
--
Jim C. Nasby, Data Architect jim(at)nasby(dot)net
512.569.9461 (cell) http://jim.nasby.net

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Florian Pflug 2014-01-23 00:57:54 Re: [PATCH] Negative Transition Aggregate Functions (WIP)
Previous Message David Rowley 2014-01-23 00:17:43 Re: [PATCH] Negative Transition Aggregate Functions (WIP)