RE: Oracle to PostgreSQL - DWH

Thanks Andy and all Experts here for your valuable inputs.

From: Andy Ellicott <andyellicott(at)gmail(dot)com>
Sent: woensdag 12 februari 2020 17:27
To: Gurudutt Dhareshwar <gurudutt(dot)dhareshwar(at)gmail(dot)com>
Cc: Amit jain <amit7(dot)jain(at)gmail(dot)com>; Bhattacharjee, Soumik <soumik(dot)bhattacharjee(at)kpn(dot)com>; pgsql-admin(at)lists(dot)postgresql(dot)org; pgsql-admin(at)postgresql(dot)org
Subject: Re: Oracle to PostgreSQL - DWH

Hi all,

Rather than Greenplum, a fresher option for data warehousing is to use standard Postgres (or EDB), but deployed on FPGA-equipped servers.

FPGAs were part of the magic inside of the old Netezza data warehouse appliances. And Amazon just announced they are using FPGA servers to speed up Redshift. FPGA-equipped hardware is becoming more common (e.g., AWS EC2 F1 instances<https://swarm64.com/post/provisioning-postgres-aws-f1-fpga/>).

You stay on free Postgres, but do require software to run on the FPGA chips... Swarm64.com (where I work) develops FPGA acceleration software for Postgres (v. 11 and up)...it adds a lot of parallel processing on the FPGA along with columnar indexing (foreign data table) to speed up queries and insertion.

Depending on the data/queries, FPGA will accelerate PG to Oracle-type speeds at terabytes scale, but for a much lower cost of course.

There's a webcast on FPGA acceleration for PG next week (19th): https://postgresconf.org/conferences/postgres-webinar-series/program/proposals/fpga-an-easier-path-to-parallelism-for-postgres

I'll share a recording of the event on this thread afterwards, in case you'd like to watch it without signing up for anything.

Please excuse the commercial plug...just meaning to inform, since it seemed relevant.

Andy

On Wed, Feb 12, 2020 at 11:06 AM Gurudutt Dhareshwar <gurudutt(dot)dhareshwar(at)gmail(dot)com<mailto:gurudutt(dot)dhareshwar(at)gmail(dot)com>> wrote:
Would suggest using snowflakes for DWH
Regards,

Gurudutt Dhareshwar
(469-288-7845)

On Feb 12, 2020, at 07:44, Amit jain <amit7(dot)jain(at)gmail(dot)com<mailto:amit7(dot)jain(at)gmail(dot)com>> wrote:

Greenplum is best suited for DW workload,based on Postgresql open source and commodity hardware can also support this.

Postgresql is OLTP DB.

Amit Jain
9833777592

On Wed, Feb 12, 2020, 7:56 PM <soumik(dot)bhattacharjee(at)kpn(dot)com<mailto:soumik(dot)bhattacharjee(at)kpn(dot)com>> wrote:
Hi Experts,

Greetings!!

Did anyone have some use cases for migrating Oracle to PostgreSQL in context to DWH(Data warehousing ) considering 5TB to 8TB database size (Source-Oracle)

Thanks..

--
Andy Ellicott
(m) +1 603 205 2804