Re: Copy data from DB2 (Linux) to PG

From: Florian Bachmann <fbachmann(dot)public(at)gmail(dot)com>
To: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: Copy data from DB2 (Linux) to PG
Date: 2018-11-11 19:10:35
Message-ID: c0c0e5e9-fbe6-fc3a-a1e4-77c2bf3b53cc@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 01.11.2018 18:27, Ravi Krishna wrote:
> I have a project to develop a script/tool to copy data from DB2 to PG. The approach I am thinking is
>
> 1. Export data from db2 in a text file, with, say pipe as delimiter.
> 2. Load the data from the text file to PG using COPY command.
>
> In order to make it faster I can parallelize export and load with upto X number of tables concurrently.
>
> Is there a tool in which I can avoid first exporting and then loading. I think one way I can do it is by
> using pipes by which I can export from db2 to a pipe and simultaneously load it to PG using COPY.
>
> Any other tool for this job?
>
> thanks.
>

Haven't tried it myself, but you may be able to connect the DB2 database
to your PostgreSQL cluster using this FDW module:
https://github.com/wolfgangbrandl/db2_fdw

Then you could just use INSERT INTO ... SELECT  statements to do the ETL
process with the necessary type conversions and whatnot.

Looks like db2_fdw is DB2 LUW only though, so you might be out of luck
if your DB2 is on IBM i (or z ;-)

Kind regards
Florian

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Andrew Gierth 2018-11-11 19:20:58 Re: query patterns for multipass aggregating
Previous Message Ondřej Bouda 2018-11-11 18:57:52 Re: query patterns for multipass aggregating