Re: extreme memory use when loading in a lot of data

From: Vivek Khera <khera(at)kcilink(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: extreme memory use when loading in a lot of data
Date: 2004-05-24 20:55:02
Message-ID: A08284A4-ADC4-11D8-9F04-000A9578CFCC@kcilink.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

>> key constraints are all met. Thus, when loading the data from the
>> second dump, I am leaving the FK triggers on.
>
> I'd suggest dropping the constraints, adding the data and adding the
> constraint again. If you're using 7.4 the speed will be better for
> checking the constraint, and if the constraint is not satisfied, you'll
> need to remove the offending row and recreate the constraint, but
> that's
> better than having to reimport.

Thanks to Stephan and Tom for the same suggestion. I'm also glad to
know it is not a leak but just a large amount of memory use. The load
is still taking a LOOONG time because it is just a lowly IDE disk (but
it is UDMA100)... 96 hours so far and the memory usage is steady.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Joe Lester 2004-05-24 21:25:30 Abnormal Exit Quandary
Previous Message Joe Conway 2004-05-24 18:15:07 Re: how many record versions