Re: Pointers towards identifying bulk import bottleneck (walwriter tuning?)

From: Luca Ferrari <fluca1978(at)gmail(dot)com>
To: "Holtgrewe, Manuel" <manuel(dot)holtgrewe(at)bihealth(dot)de>
Cc: pgsql-general <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Pointers towards identifying bulk import bottleneck (walwriter tuning?)
Date: 2019-08-27 11:28:13
Message-ID: CAKoxK+6t5JgLwOUq+kCkp9i9g6c4CyTm8mkuigS9GBqtaTUMAg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Tue, Aug 27, 2019 at 12:06 PM Holtgrewe, Manuel
<manuel(dot)holtgrewe(at)bihealth(dot)de> wrote:
> iotop tells me that walwriter does not go beyond ~35MB/s so maybe this is the culprit? Is there a way to tune walwriter I/O performance?

As far as I know, walwriter is there to help background processes, so
in the case it cannot keep up with WALs the backends will write on
their own. If my understanding is correct, I don't think that could be
the bootleneck.
I've seen you have checkpoints at 4h, that's quite huge to me. Do you
have any hint that checkpoints are happening too frequently?
Any chance you can turn fsync off (only if this is a testbed)?

Also this <https://www.postgresql.org/list/pgsql-performance/> could
be a better place to ask for help.

Luca

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Shaozhong SHI 2019-08-27 12:06:12 Re: psql \copy hanging
Previous Message Arnaud L. 2019-08-27 11:17:17 Re: psql \copy hanging