Re: performance of pg_upgrade "Copying user relation files"

From: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
To: Glenn Pierce <glennpierce(at)gmail(dot)com>, pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: performance of pg_upgrade "Copying user relation files"
Date: 2019-10-02 23:16:29
Message-ID: a501a04b-e5a1-174c-cf71-35271c783e2c@aklaver.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 10/2/19 3:30 PM, Glenn Pierce wrote:
> I have been trying to upgrade postgres 9.5 to 9.6 with pg_upgrade
>
> Everything seems to start fine but when pg_upgrade gets to "Copying
> user relation files"
> It takes ages to complete copying.

Adding to previous list:

4) Which pg_upgrade version did you use, 9.5 or 9.6?

>
> ie
> Each file like
>
> /var/lib/pgsql/9.5/data/base/24602/25140
> is 1G and taking ~5-10 minutes to copyand that directory is 223G of
> about 990 files
>
> After a couple of hours running pg_upgrade I had to give up.
>
> looking a iotop I was seeing
>
> 99% IO load caused by [md0_raid1]
>
> and only seeing pg_upgrade go to 99% every 3-4 seconds
>
> I had no other processes using io or high cpu.
>
> Has anyone got any pointers of what could be the issue ?
>
> Ps running cp on /var/lib/pgsql/9.5/data/base/24602/25140 to my home
> directory is instantaneous
>
> System is Centos 7
>
> Thanks
>
>

--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2019-10-02 23:23:20 Re: Wall shiping replica failed to recover database with error: invalid contrecord length 1956 at FED/38FFE208
Previous Message Adrian Klaver 2019-10-02 23:11:22 Re: performance of pg_upgrade "Copying user relation files"