Newbie: PG8 and text file parsing

From: Paul R <blueaxon(at)gmail(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Newbie: PG8 and text file parsing
Date: 2005-02-19 01:34:09
Message-ID: 3eb42da105021817342feb0b2d@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

I need some advice.. I am new to PG8 - I am working on the project
that needs to load data daily to PostgreSQL from the text file.. the
text file is 40MB comma delimited file with row consisting of 20-30
fields and couple thousands of rows..

so the data needs to be parsed and if the row exists it needs to be
updated, otherwise new record is going to be created. My problem is
with parsing:

1-what would be a good approach to do it? is plpgSQL suitable for
this? or should I use PHP or other language to to that and run as a
cron job/service?

2-how about committing transactions? would there be a problem if it
is done at the end of all the updates?

Thank you
Paul

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Steve Crawford 2005-02-19 01:37:00 Re: is there anyway to get the backends IP address from the
Previous Message Ed L. 2005-02-19 00:25:05 Re: hung postmaster?