From: | Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com> |
---|---|
To: | pgsql-general(at)lists(dot)postgresql(dot)org |
Subject: | Re: Multiple COPY on the same table |
Date: | 2018-08-20 20:23:13 |
Message-ID: | c51bbe16-8cb5-6e8b-4ba8-f00ee44b1c63@aklaver.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
On 08/20/2018 08:56 AM, Nicolas Paris wrote:
>> Can I split a large file into multiple files and then run copy using
>> each file.
>
> AFAIK, copy command locks the table[1] while there is no mention of this
> in the documentation[2].
[1] Is from Postgres 7.1(17 years ago). I suspect the conditions have
changed at least a little:).
>
>> Will the performance boost by close to 4x??
>
> You might be interested in the pbBulkInsert tool[3] that allows parallel
> copy with some succes accordingly to benchmarks. However, that tool does
> not handle multiline csv. Because of that limitation I have been using
> the standard copy command with binary format with some succes.
>
>
> [1] https://grokbase.com/t/postgresql/pgsql-general/01597pv3qs/copy-locking
> [2] https://www.postgresql.org/docs/current/static/sql-copy.html
> [3] https://github.com/bytefish/PgBulkInsert
>
>
--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com
From | Date | Subject | |
---|---|---|---|
Next Message | Zhiquan Simon Sui | 2018-08-21 00:46:20 | Question about replication |
Previous Message | Stephen Frost | 2018-08-20 19:15:43 | Re: upgrading from pg 9.3 to 10 |