JSON out of memory error on PostgreSQL 9.6.x

From: Yuri Budilov <yuri(dot)budilov(at)hotmail(dot)com>
To: John R Pierce <pierce(at)hogranch(dot)com>, "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: JSON out of memory error on PostgreSQL 9.6.x
Date: 2017-12-03 23:18:50
Message-ID: DM5PR13MB17557D9BE4B9846D16D05405993F0@DM5PR13MB1755.namprd13.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Posted on Stack Overflow, sadly no replies, so trying here....

CREATE TABLE X AS
SELECT json_array_elements(json_rmq -> 'orders'::text) AS order
FROM table_name
WHERE blah;

I get out of memory error.

Is there anything I can do to unpack the above?

The JSON column is about ~5 MB and it has about ~150,000 array row elements in 'orders' above.

I tried work_mem values up to ~250MB and it did not help, the query takes about same time to fail.

I guess this parameter does not help JSON processing.

If there another parameter I can try? Something else?

I don't have control of the size of the JSON payload, it arrives, we store it in a JSON column and then we need to crack it open.

Many thanks!

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2017-12-04 00:01:09 Re: JSON out of memory error on PostgreSQL 9.6.x
Previous Message hvjunk 2017-12-03 22:17:36 Re: building a server