Re: New statistics for tuning WAL buffer size

From: Fujii Masao <masao(dot)fujii(at)oss(dot)nttdata(dot)com>
To: Masahiro Ikeda <ikedamsh(at)oss(dot)nttdata(dot)com>, tsunakawa(dot)takay(at)fujitsu(dot)com
Cc: PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: New statistics for tuning WAL buffer size
Date: 2020-08-20 11:01:29
Message-ID: ac606d8b-cca0-36a5-73bf-4ab4419bb972@oss.nttdata.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 2020/08/19 14:10, Masahiro Ikeda wrote:
> On 2020-08-19 13:49, tsunakawa(dot)takay(at)fujitsu(dot)com wrote:
>> From: Masahiro Ikeda <ikedamsh(at)oss(dot)nttdata(dot)com>
>>> If my understanding is correct, we have to measure the performance
>>> impact first.
>>> Do you know HariBabu is now trying to solve it? If not, I will try to
>>> modify patches to apply HEAD.
>>
>> No, he's not doing it anymore.  It'd be great if you could resume it.
>
> OK, thanks.
>
>> However, I recommend sharing your understanding about what were the
>> issues with those two threads and how you're trying to solve them.
>> Was the performance overhead the blocker in both of the threads?
>
> In my understanding, some comments are not solved in both of the threads.
> I think the following works are remained.
>
> 1) Modify patches to apply HEAD
> 2) Get consensus what metrics we collect and how to use them for tuning.

I agree to expose the number of WAL write caused by full of WAL buffers.
It's helpful when tuning wal_buffers size. Haribabu separated that number
into two fields in his patch; one is the number of WAL write by backend,
and another is by background processes and workers. But I'm not sure
how useful such separation is. I'm ok with just one field for that number.

Regards,

--
Fujii Masao
Advanced Computing Technology Center
Research and Development Headquarters
NTT DATA CORPORATION

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Fujii Masao 2020-08-20 11:19:29 Re: New statistics for tuning WAL buffer size
Previous Message David Rowley 2020-08-20 10:51:41 Re: Fix a couple of typos in JIT