From: | "Armand Pirvu (home)" <armand(dot)pirvu(at)gmail(dot)com> |
---|---|
To: | "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org> |
Subject: | data transformation and replication |
Date: | 2017-05-08 19:46:32 |
Message-ID: | 11C8CC74-66AF-468B-B1F7-8B9505062947@gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
Hi
Here it is a scenario which I am faced with and I am hoping to find a pointer/tip/help
db1 is the OLTP system
db2 is the Reporting system
The data from db1 needs to get to db2, but the database on those two have tables with different layout/structure and hence data will need to suffer some transformation in between in real time
I was looking at something like
db1 -> db2 replicates the same set of tables and with the same structures using pglogical for example
db2.tbl1 -> db2.tbl2 data gets massages/transformed based on what replicates from db1.tbl1 using triggers and functions
Other than that I reckon db1 -> db2 would be trigger based using something like slonik maybe (?) and data massage/transformation gets moved from db2 to db1 machine and then db1.tbl2 -> db2.tbl2 using pglogical
Is this doable ? If so any pointers as to where to look about it ?
Many thanks
Armand
From | Date | Subject | |
---|---|---|---|
Next Message | Paul Hughes | 2017-05-08 21:26:02 | Python versus Other Languages using PostgreSQL |
Previous Message | Scott Marlowe | 2017-05-08 18:54:12 | Re: Can PG replace redis, amqp, s3 in the future? |