Re: create batch script to import into postgres tables

From: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
To: Pepe TD Vo <pepevo(at)yahoo(dot)com>, Christopher Browne <cbbrowne(at)gmail(dot)com>
Cc: Pgsql-admin <pgsql-admin(at)postgresql(dot)org>, Pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: create batch script to import into postgres tables
Date: 2020-06-18 16:08:23
Message-ID: cd3af30c-41a2-4df1-d41e-6316b692227e@aklaver.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin pgsql-general

On 6/18/20 8:20 AM, Pepe TD Vo wrote:

Please don't top post. The preferred style on this list is inline or
bottom posting(https://en.wikipedia.org/wiki/Posting_style).

> I have a Postgresql client installed and connected.  how can i create a
> batch script running from the client window?

Create a file with commands in it like the example from Christopher
Browne that was posted earlier:

"There is no single straightforward answer to that.

Supposing I want a batch to either all be processed, or to all not process,
then I might write a sql file like:

begin;
\copy table_1 (c1, c2, c3) from '/path/tabledata1.csv' csv header;
\copy table_2 (c1, c2, c3) from '/path/tabledata2.csv' csv header;
\copy table_3 (c1, c2, c3) from '/path/tabledata3.csv' csv header;
commit;

But you may be fine with having a separate SQL script for each table.

There will be conditions where one or the other is more appropriate, and
that will be based on the requirements of the process."

Then point psql at it:

psql -d some_db -h some_host -U some_user -f the_file

Be aware that \copy is all or nothing. If there is a single failure in
the copying the whole copy will rollback. Given that the one file per
table might be preferable.

>
> **
> *Bach-Nga
>

--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Pepe TD Vo 2020-06-18 16:40:00 Re: create batch script to import into postgres tables
Previous Message Hotmail 2020-06-18 15:54:54 Any optimizations using oracle_fdw with oracle tables that have clob columns?

Browse pgsql-general by date

  From Date Subject
Next Message Pepe TD Vo 2020-06-18 16:40:00 Re: create batch script to import into postgres tables
Previous Message Tom Lane 2020-06-18 15:21:02 Re: ESQL/C no indicator variables ./. error -213