Re: Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?

On 09/10/2013, at 8:39 PM, raghu ram <raghuchennuru(at)gmail(dot)com> wrote:

>
> On Mon, Oct 7, 2013 at 8:32 PM, sunpeng <bluevaley(at)gmail(dot)com> wrote:
> Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?
>
>
> ETL Tools for PostgreSQL::
>
> Definition: An ETL process data to load into the database from a flat file
>
> A. Extract
> B. Transform
> C. Load
>
> 1. PGLoader - Load .csv file
> 2. Benetl 1.8 - Load .txt or .csv or .xls file
> 3. Talend Open Studio => http://www.talend.com/index.php
> 4. Pentaho Kettle => http://kettle.pentaho.com/
> 5. Visual Importer => Data can be imported from flat files,Excel.MS Access,Oracle.Mysql.Interbase,PostgreSQL,oleDB,ODBC and DBF files.
> 6. CloverETL => http://en.wikipedia.org/wiki/CloverETL
>
> Both [3 &4] of these ETL solutions have a lot of the same types of features:
>
> Both are Java based and run on Linux and Windows (Talend is Eclipse-based)
> Visual designers for creating the transformations
> Connectivity for a myriad of databases, including all the big DBs, text formats, etc.
> Supports distributing jobs across multiple servers if you are doing serious lifting
> Excellent error handling and error notification systems
> Active and helpful forums (Kettle is older and seems to have a larger community however)
> Free and open source
> They are complex enough to handle a lot of tasks, but not so much as to kill you
> There are versions of both (GeoKettle and Spatial Data Integrator) that are tailored for GIS

Not exactly an ETL tool, but I've recently felt a sense of liberation since switching to make/python/psql/wget... for my ETL needs. Make is probably the cornerstone as it handles dependencies (think foreign key ordering with schema introspection) and parallel loading in a very intuitive way.

Cheers,

Tony