RE: [ext] Re: Pointers towards identifying bulk import bottleneck (walwriter tuning?)

From: "Holtgrewe, Manuel" <manuel(dot)holtgrewe(at)bihealth(dot)de>
To: Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>, Luca Ferrari <fluca1978(at)gmail(dot)com>
Cc: pgsql-general <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: RE: [ext] Re: Pointers towards identifying bulk import bottleneck (walwriter tuning?)
Date: 2019-08-28 05:29:04
Message-ID: CC941ED861F3AA469B6D50EE76C57483015EAC0F33@s-mx14-bih01.charite.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

I guess this cannot be pointed out too often ;) I'm not intending to do this but the behaviour of the system with fsync=off led me to further understand that the bottleneck had to be CPU-related rather than I/O-related. Of course, I never switched off fsync on the production system.

Best wishes,

________________________________________
From: Laurenz Albe [laurenz(dot)albe(at)cybertec(dot)at]
Sent: Wednesday, August 28, 2019 05:45
To: Holtgrewe, Manuel; Luca Ferrari
Cc: pgsql-general
Subject: Re: [ext] Re: Pointers towards identifying bulk import bottleneck (walwriter tuning?)

Holtgrewe, Manuel wrote:
> Switching off fsync leads to a drastic time improvement but still
> higher wall-clock time for four threads.

Don't do that unless you are ready to start from scratch with a new
"initdb" in the case of a crash.

You can do almost as good by setting "synchronous_commit = off",
and that is crash-safe.

Yours,
Laurenz Albe
--
Cybertec | https://www.cybertec-postgresql.com

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Sonam Sharma 2019-08-28 06:58:51
Previous Message Ron 2019-08-28 04:56:27 Re: Work hours?