Upgrade from 11.3 to 13.1 failed with out of memory

From: Mihalidesová Jana <jana(dot)mihalidesova(at)cetin(dot)cz>
To: "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Upgrade from 11.3 to 13.1 failed with out of memory
Date: 2021-04-06 06:15:20
Message-ID: DBBPR08MB4888C06C27C2DA7AE14AAEBA90769@DBBPR08MB4888.eurprd08.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Open

Hi,

I have aproximetly 560GB large database and try to upgrade it from 11.3 to 13.1. I’ve successfully upgraded dev,test and ref environment but on the production pg_dump failed with out of memory. Yes, of course, the dev,test and ref are much much smaller then production database.
We are using OID data type so there’s a lot of large objects. pg_largeobject it’s 59GB large.
The upgrade process fail during the pg_dump schemas_only so I’m confused why it’s not enough 35GB RAM which is free on the server when there’s no data. When I tried to run same pg_dump command by hand as during upgrade it fails on line pg_dump: reading large objects.

Creating dump of global objects "/pgsql/bin/13.1_XXXX/bin/pg_dumpall" --host /pgsql/data/XXXX --port 50432 --username XXXXXX --globals-only --quote-all-identifiers --binary-upgrade --verbose -f pg_upgrade_dump_globals.sql >> "pg_upgrade_utility.log" 2>&1
ok
Creating dump of database schemas
"/pgsql/bin/13.1_XXXX/bin/pg_dump" --host /pgsql/data/XXXX --port 50432 --username XXXXXX --schema-only --quote-all-identifiers --binary-upgrade --format=custom --verbose --file="pg_upgrade_dump_16384.custom" 'dbname=XXXX' >> "pg_upgrade_dump_16384.log" 2>&1

*failure*
There were problems executing ""/pgsql/bin/13.1_XXXX/bin/pg_dump" --host /pgsql/data/XXXX --port 50432 --username pgpnip --schema-only --quote-all-identifiers --binary-upgrade --format=custom --verbose --file="pg_upgrade_dump_16384.custom" 'dbname=XXXX' >> "pg_upgrade_dump_16384.log" 2>&1"

Do you have any idea how to upgrade the database? This is my upgrade command:

/pgsql/bin/13.1_XXXX/bin/pg_upgrade -k -b /pgsql/bin/11.3_XXXX/bin -B /pgsql/bin/13.1_XXXX/bin -d /pgsql/data/XXXX -D /pgsql/data/XXXX/XXXX.new

Thank you for any ideas.

Best regards,

Jana Mihalidesova
Database Administrator

►CETIN a.s.
Českomoravská 2510/19, 190 00 Praha 9
m: +420 603 419 862 t: +420 238 465 074
jana(dot)mihalidesova(at)cetin(dot)cz

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Laurenz Albe 2021-04-06 08:46:08 Re: questions about wraparound
Previous Message Merlin Moncure 2021-04-06 02:53:03 Re: Primary keys and composite unique keys(basic question)