Re: Disable WAL logging to speed up data loading

From: David Steele <david(at)pgmasters(dot)net>
To: "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>, "osumi(dot)takamichi(at)fujitsu(dot)com" <osumi(dot)takamichi(at)fujitsu(dot)com>
Cc: 'Kyotaro Horiguchi' <horikyota(dot)ntt(at)gmail(dot)com>, "sawada(dot)mshk(at)gmail(dot)com" <sawada(dot)mshk(at)gmail(dot)com>, "robertmhaas(at)gmail(dot)com" <robertmhaas(at)gmail(dot)com>, "masao(dot)fujii(at)oss(dot)nttdata(dot)com" <masao(dot)fujii(at)oss(dot)nttdata(dot)com>, "laurenz(dot)albe(at)cybertec(dot)at" <laurenz(dot)albe(at)cybertec(dot)at>, "ashutosh(dot)bapat(dot)oss(at)gmail(dot)com" <ashutosh(dot)bapat(dot)oss(at)gmail(dot)com>, "pgsql-hackers(at)lists(dot)postgresql(dot)org" <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: Disable WAL logging to speed up data loading
Date: 2021-03-18 16:50:11
Message-ID: c3b64bb9-5108-796b-93db-96d2cee0c3a2@pgmasters.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 1/17/21 12:16 AM, tsunakawa(dot)takay(at)fujitsu(dot)com wrote:
> From: Osumi, Takamichi/大墨 昂道 <osumi(dot)takamichi(at)fujitsu(dot)com>
>> I updated my patch to take in those feedbacks !
>> Have a look at the latest patch.
>
> Looks good to me (the status remains ready for committer.)

After reading through the thread (but not reading the patch) I am -1 on
this proposal.

The feature seems ripe for abuse and misunderstanding, and as has been
noted in the thread, there are a variety of alternatives that can
provide a similar effect.

It doesn't help that at several points along the way new WAL records
have been found that still need to be included even when wal_level =
none. It's not clear to me how we know when we have found them all.

The patch is marked Ready for Committer but as far as I can see there
are no committers in favor of it and quite a few who are not.

Perhaps it would be better to look at some of the more targeted
approaches mentioned in the thread and see if any of them can be
used/improved to achieve the desired result?

Regards,
--
-David
david(at)pgmasters(dot)net

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Fujii Masao 2021-03-18 16:50:22 Re: fdatasync performance problem with large number of DB files
Previous Message Tomas Vondra 2021-03-18 16:40:22 Re: cleanup temporary files after crash