Out of Memory during Insert

From: yue peng <pengyuebupt(at)gmail(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Out of Memory during Insert
Date: 2010-03-24 10:57:34
Message-ID: e8b67231003240357j566a4dfcpdda77a762cf6d7a9@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Dear, Psqlers,

I encountered an out of memory error during executing un INSERT into
table1(v1,v2,v3) SELECT c1,c2,c3 from table2 where .....
The recordset of Select query is around 30M record. And I got following
Message :

------- ERROR: out of memoryDETAIL: Failed on request of size 40.' in
'insert into -------------------

I found my postgresql process used up 3G Memory . I guess postgresql try to
first get all the result of select , and then insert into Table . As the
process can't allocate more memory for result of select , and then I got OOM
error. Can someone verify my guess ? Or what else could be the reason of OOM
?

Is there any other ways to still insert same amount of data and avoid this
OOM error ?

Thanks ,
--
Yue

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Nilesh Govindarajan 2010-03-24 11:50:40 Re: Help me with this multi-table query
Previous Message Frank jansen 2010-03-24 10:22:48 Concatenate