| From: | Marc-André Goderre <magoderre(at)cgq(dot)qc(dot)ca> |
|---|---|
| To: | "'pgsql-general(at)postgresql(dot)org' (pgsql-general(at)postgresql(dot)org)" <pgsql-general(at)postgresql(dot)org> |
| Subject: | Invalid memory alloc |
| Date: | 2015-04-23 19:55:25 |
| Message-ID: | D8DAC91BA6256246BA3FF835F6AAA1189943F676@SI-MB01.cegep-chicoutimi.qc.ca |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-general |
Hello, I'm processing a 100Million row table.
I get error message about memory and I'ld like to know what can cause this issue.
...
psql:/home/ubuntu/create_topo.sql:12: NOTICE: 104855000 edges processed
psql:/home/ubuntu/create_topo.sql:12: NOTICE: 104856000 edges processed
psql:/home/ubuntu/create_topo.sql:12: NOTICE: 104857000 edges processed
psql:/home/ubuntu/create_topo.sql:12: NOTICE: invalid memory alloc request size 1677721600
psql:/home/ubuntu/create_topo.sql:12: NOTICE: UPDATE public.way_noded SET source = 88374866,target = 88362922 WHERE id = 142645362
pgr_createtopology
--------------------
FAIL
(1 row)
The server has a 10Gb of shared_buffer.
Do you thing this quantity of memory allowed should normaly be enough to process the data?
Thanks
Marc
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Edson Richter | 2015-04-23 20:15:46 | Re: Invalid memory alloc |
| Previous Message | billythebomber | 2015-04-23 18:42:59 | BDR Across Distributed Nodes |