Re: parallel pg_dump

On 04/05/2012 12:32 PM, Joachim Wieland wrote:
> So here's a pg_dump benchmark from a real world database as requested
> earlier. This is a ~750 GB large 9.0.6 database, and the backup has
> been done over the internal network from a different machine. Both
> machines run Linux.
>
> I am attaching a chart that shows the table size distribution of the
> largest tables and the overall pg_dump runtime. The resulting (zlib
> compressed) dump directory was 28 GB.
>
> Here are the raw numbers:
>
> -Fc dump
> real 168m58.005s
> user 146m29.175s
> sys 7m1.113s
>
> -j 2
> real 90m6.152s
> user 155m23.887s
> sys 15m15.521s
>
> -j 3
> real 61m5.787s
> user 155m33.118s
> sys 13m24.618s
>
> -j 4
> real 44m16.757s
> user 155m25.917s
> sys 13m13.599s
>
> -j 6
> real 36m11.743s
> user 156m30.794s
> sys 12m39.029s
>
> -j 8
> real 36m16.662s
> user 154m37.495s
> sys 11m47.141s

interesting numbers, any details on the network speed between the boxes,
the number of cores, the size of the dump uncompressed and what the
appearant bottleneck was?

Stefan