Re: importing a messy text file

From: Michael Paquier <michael(dot)paquier(at)gmail(dot)com>
To: bricklen <bricklen(at)gmail(dot)com>
Cc: Willy-Bas Loos <willybas(at)gmail(dot)com>, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: importing a messy text file
Date: 2014-05-01 04:02:14
Message-ID: CAB7nPqSa9uBTS+W7-k89SRsfEEjM=zqH+mX4FqTSuYq=V97hag@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Thu, May 1, 2014 at 1:30 AM, bricklen <bricklen(at)gmail(dot)com> wrote:
>
> On Wed, Apr 30, 2014 at 1:07 AM, Willy-Bas Loos <willybas(at)gmail(dot)com> wrote:
>>
>>
>> Hi,
>>
>> I have a 56GB textfile that i want to import into postgres.
>> The file is tab delimited and not quoted.
>
>
> Would Pgloader be an option? http://tapoueh.org/pgloader/
Or pg_bulkload? Contrary to the in-core COPY, it can filter
"incorrect" tuple data at the line level.
--
Michael

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Francisco Olarte 2014-05-01 10:32:29 Re: Vacuuming strategy
Previous Message Michael Paquier 2014-05-01 04:00:34 Re: WAL Replication + PITR