Re: Importing a Large .ndjson file

From: Sankar P <sankar(dot)curiosity(at)gmail(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: Importing a Large .ndjson file
Date: 2020-06-18 17:38:44
Message-ID: CAMSEaH7Vkh3JfwjJfFjQH-UtjEf71aSgA0aEEjqpE42MnLUYcQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

> > It looks like plain old COPY would do this just fine, along the lines
> > of (in psql)
> >
> > \copy myTable(content) from 'myfile.ndjson'

I spoke too soon. While this worked fine when there were no indexes
and finished within 10 minutes, with GIN index on the jsonb column, it
is taking hours and still not completing.

--
Sankar P
http://psankar.blogspot.com

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Michael Lewis 2020-06-18 18:09:11 Re: Importing a Large .ndjson file
Previous Message Michel Pelletier 2020-06-18 17:34:51 Re: Hiding a GUC from SQL