Re: OOM killer while pg_restore

From: Ranier Vilela <ranier(dot)vf(at)gmail(dot)com>
To: Marc Rechté <marc4(at)rechte(dot)fr>
Cc: Pgsql Performance <pgsql-performance(at)lists(dot)postgresql(dot)org>
Subject: Re: OOM killer while pg_restore
Date: 2022-03-03 11:00:38
Message-ID: CAEudQArBWbNHkq2sEPvqHG8G9+CVcEcyDunLCAoXEAeec097fQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Em qui., 3 de mar. de 2022 às 05:59, Marc Rechté <marc4(at)rechte(dot)fr> escreveu:

> Hello,
>
> We have a pg_restore which fails due to RAM over-consumption of the
> corresponding PG backend, which ends-up with OOM killer.
>
> The table has one PK, one index, and 3 FK constraints, active while
> restoring.
> The dump contains over 200M rows for that table and is in custom format,
> which corresponds to 37 GB of total relation size in the original DB.
>
> While importing, one can see the RSS + swap increasing linearly for the
> backend (executing the COPY)
>
> On my machine (quite old PC), it failed after 16 hours, while the disk
> usage was reaching 26 GB and memory usage was 9.1g (RSS+swap)
>
> If we do the same test, suppressing firstly the 5 constraints on the
> table, the restore takes less than 15 minutes !
>
> This was tested on both PG 14.2 and PG 13.6 (linux 64-bit machines).
>
> It there a memory leak or that is normal that a bacend process may exhaust
> the RAM to such an extent ?
>
Hi Marc,
Can you post the server logs?

regards,
Ranier Vilela

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Marc Rechté 2022-03-03 12:18:59 Re: OOM killer while pg_restore
Previous Message Marc Rechté 2022-03-03 08:59:03 OOM killer while pg_restore