Re: WAL directory size calculation

From: Moreno Andreo <moreno(dot)andreo(at)evolu-s(dot)it>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: WAL directory size calculation
Date: 2016-07-28 16:27:41
Message-ID: 6d49d526-70d4-0005-fea9-360ee1b59825@evolu-s.it
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">Il 28/07/2016 15:33, David G. Johnston
ha scritto:<br>
</div>
<blockquote
cite="mid:CAKFQuwaMGb-qMnf0T0F35NQg_FidzVugnBYhSz3AybMwkwppOg(at)mail(dot)gmail(dot)com"
type="cite">
<div dir="ltr">
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif"><span
style="font-family:arial,sans-serif">On Thu, Jul 28, 2016 at
9:25 AM, Moreno Andreo </span><span dir="ltr"
style="font-family:arial,sans-serif">&lt;<a
moz-do-not-send="true"
href="mailto:moreno(dot)andreo(at)evolu-s(dot)it" target="_blank">moreno(dot)andreo(at)evolu-s(dot)it</a>&gt;</span><span
style="font-family:arial,sans-serif"> wrote:</span><br>
</div>
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">I've
read somewhere that the formula should be 16 MB * 3 *
checkpoint_segment in size.<br>
</blockquote>
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif;display:inline">​[...]​</div>
 </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">Using
the above formula I have:<br>
    16 MB * 3 * 1 GB<br>
that leads to to ... uh .. 48000 TB?<br>
</blockquote>
<div><br>
</div>
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif">​You seem
to be mis-remembering the formula.​</div>
</div>
</div>
</div>
</div>
</blockquote>
The result is too big to be sane... so there *must* be something
wrong<br>
<blockquote
cite="mid:CAKFQuwaMGb-qMnf0T0F35NQg_FidzVugnBYhSz3AybMwkwppOg(at)mail(dot)gmail(dot)com"
type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div><br>
</div>
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif;display:inline">​checkpoiint_segments
is a quantity (i.e., unit-less), not a size.  Saying its
"1GB" makes no sense.</div>
</div>
</div>
</div>
</div>
</blockquote>
Yes, my "1 GB" is related to max_wal_file_size, that from 9.5 came
over checkpoint_segment.<br>
<blockquote
cite="mid:CAKFQuwaMGb-qMnf0T0F35NQg_FidzVugnBYhSz3AybMwkwppOg(at)mail(dot)gmail(dot)com"
type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif;display:inline"><br>
</div>
</div>
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif;display:inline">​I'm
also doubting you multiply it by 3 - add three to it
maybe...</div>
</div>
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif;display:inline"><br>
</div>
</div>
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif">​Each
segment takes 16MB.  The total space required is that
times whatever maximum count of segments you expect to
have.​</div>
</div>
</div>
</div>
</div>
</blockquote>
That's the variable. How many segments do I expect to have? (jumping
from 9.1 (current) to 9.5 (new) documentation and having a bit of
confusion in my head...)<br>
<br>
<blockquote
cite="mid:CAKFQuwaMGb-qMnf0T0F35NQg_FidzVugnBYhSz3AybMwkwppOg(at)mail(dot)gmail(dot)com"
type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif"><br>
</div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif">I'd
suggest waiting for better responses on these lists
...[snip]...</div>
</div>
</div>
</div>
</div>
</blockquote>
Got one, in fact. The statement to *absolutely* not use ramdisk with
wal files resolved almost all of my doubts.<br>
<br>
<blockquote
cite="mid:CAKFQuwaMGb-qMnf0T0F35NQg_FidzVugnBYhSz3AybMwkwppOg(at)mail(dot)gmail(dot)com"
type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif"><br>
</div>
<div class="gmail_default"
style="font-family:arial,helvetica,sans-serif">David J.</div>
<br>
</div>
</div>
</div>
</div>
</blockquote>
<p>Thanks</p>
<p>Moreno<br>
</p>
</body>
</html>

Attachment Content-Type Size
unknown_filename text/html 5.6 KB

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Adrian Klaver 2016-07-28 16:31:19 Re: Multiple NOTIFY is ignored
Previous Message Tom Lane 2016-07-28 16:15:49 Re: Multiple NOTIFY is ignored