copy a large table raises out of memory exception

From: "A(dot) Ozen Akyurek" <ozen(at)ventura(dot)com(dot)tr>
To: <pgsql-general(at)postgresql(dot)org>
Subject: copy a large table raises out of memory exception
Date: 2007-12-10 09:19:05
Message-ID: 002501c83b0d$b84d33a0$8c00a8c0@OZEN
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

We have a large table (about 9,000,000 rows and total size is about 2.8 GB)
which is exported to a binary file. Postgre 8.2 is running on a Windows 2003
Small business Server which has a 2 GB RAM. When we run "copy tablename from
filepath" command, memory usage increases up to 1.8 GB and postgre raises
exception "out of memory". If we copy a small part of the table (e.g
1,000,000 rows) everything works fine.

As far as I understand, postgre is trying to load all the rows into RAM
before writing it to the database. I tried running postgre with several
different configuration parameters but the result is same. Did anybody face
a similar problem?

Kind regards
A. Ozen Akyurek

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Richard Huxton 2007-12-10 09:45:10 Re: Pg_catalog reference
Previous Message Tom Lane 2007-12-10 05:48:19 Re: Simpler dump?