Re: pg_dump performance issues

Dominique:

On Thu, 22 Feb 2024 at 10:50, Dominique Devienne <ddevienne(at)gmail(dot)com> wrote:
> In the past, I've read [this post][1] from Marc Millas that reports `pg_dump ... | psql` at throughput around 500MB/s (5Gb/s) on a 10Gb/s network.

That is half the theoretical bandwidth,more or less.

> I tried against a v12 and v14 Linux servers (real hardware, server-class machines, in the $10K range each, 2 years old and 7 years old, running RedHat 7)
> I'm on a 1Gb/s LAN.
The you would max out at about 50 if getting the same behaviour as
your reference.

> The client side is a Windows 11 PRO desktop running 16.1 release builds of pg_dump (and my own client).

Before doing any more thing you should test the network throughput
between your client and servers, on a naked connection. There are
plenty of programs for these, even a ftp/scp/network file copy would
be a useful reference. You have not provided any and.....

> .... in the 10-12MB/s throughput range.....

This has the faint smell of a saturated 100Mbps link in the middle (12*8=96Mbps)

Make some tests of the network and measure ( and post them ) before,
so people can guesstimate something.

Francisco Olarte.