Re: Ora2pg Delta Migration: Oracle to PostgreSQL

From: Amit Sharma <amitpgsql(at)gmail(dot)com>
To: Avinash Vallarapu <avinash(dot)vallarapu(at)gmail(dot)com>
Cc: Muhammad Ikram <mmikram(at)gmail(dot)com>, Ron Johnson <ronljohnsonjr(at)gmail(dot)com>, PostgreSQL General <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Ora2pg Delta Migration: Oracle to PostgreSQL
Date: 2024-05-03 14:19:00
Message-ID: CAHER7LoShOckUN5ET8xzkVOkNK650LRVwqSKRJ-=5_hr-cZqzA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Thanks Avinash. Appriciate the help!!

Regards
Amit

On Fri, May 3, 2024 at 5:38 AM Avinash Vallarapu <
avinash(dot)vallarapu(at)gmail(dot)com> wrote:

> Hi,
>
> Has anyone tried delta/incremental data migration for Oracle to PostgreSQL
>> using Ora2pg? Or what are the best options to run delta migration for
>> Oracle to PostgreSQL?
>
>
> There are a few ways of dealing with it when using Ora2Pg.
>
> *Option 1 : *Ora2Pg configuration file allows us to pass the
> conditions(predicates) to be applied to a table while migrating the data
> from a table. So, if there is a way to filter the data since the last full
> load, you can pass the condition to the configuration file, for each table.
> This is some work for sure but it works great if you are able to identify
> those conditions such as creation_date or last_updated_date, let's say.
>
> *Option2 :* Ora2Pg is currently CDC ready. What this means is that,
> Ora2Pg can provide the SCN at which the table copy has been initiated.
> Technically, we provide the SCN to the CDC tools or custom CDC techniques
> to continue replication since that SCN.
>
> *Option 2.1 :* Leverage Debezium, an Open Source solution to perform
> continuous replication from Oracle to PostgreSQL from the SCN produced by
> Ora2Pg for that table.
>
> So, it is all about Ora2Pg + Debezium
>
> It might be initially challenging, but you will get there.
>
> Regards,
> Avi Vallarapu,
> CEO,
> HexaCluster Corp.
>
>
>
>
>
>
> On Fri, May 3, 2024 at 3:25 AM Muhammad Ikram <mmikram(at)gmail(dot)com> wrote:
>
>> Hi,
>>
>> Not related to Ora2PG but in the past I have used the EDB Migration
>> toolkit for such scenarios. Filterprops option can help in specifying
>> filter (where clause).
>>
>> Regards,
>> Ikram
>>
>>
>> On Fri, May 3, 2024 at 8:12 AM Ron Johnson <ronljohnsonjr(at)gmail(dot)com>
>> wrote:
>>
>>> On Thu, May 2, 2024 at 8:28 PM Amit Sharma <amitpgsql(at)gmail(dot)com> wrote:
>>>
>>>> Hello,
>>>>
>>>> Has anyone tried delta/incremental data migration for Oracle to
>>>> PostgreSQL using Ora2pg? Or what are the best options to run delta
>>>> migration for Oracle to PostgreSQL?
>>>>
>>>
>>> What do the ora2pg docs say about whether or not that feature is
>>> implemented? (It wasn't when I last used it in 2022.)
>>>
>>>
>>
>>
>> --
>> Muhammad Ikram
>>
>>
>

In response to

Browse pgsql-general by date

  From Date Subject
Next Message David Gauthier 2024-05-03 20:58:26 \dt shows table but \d <table> says the table doesn't exist ?
Previous Message Iman Bakhtiari 2024-05-03 12:11:36 I have ansible for postgres-etcd-patroni