From: | Kumar S <ps_postgres(at)yahoo(dot)com> |
---|---|
To: | Michael Fuhr <mike(at)fuhr(dot)org> |
Cc: | pgsql-novice(at)postgresql(dot)org |
Subject: | Re: background jobs |
Date: | 2005-03-06 16:05:44 |
Message-ID: | 20050306160544.9076.qmail@web51405.mail.yahoo.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-novice |
Hi ,
thank you very much for your helpful comments.
I cannot use COPY because I am using a many SELECT
statements in INSERT statements.
also one more clarification:
is the syntax correct for a transaction:
BEGIN TRANSACTION;
INSERT .........
INSERT.......
INSERT.......
100 k LINES
in case if want to rollback:
# ROLLBACK;
Thank you.
--- Michael Fuhr <mike(at)fuhr(dot)org> wrote:
> On Sat, Mar 05, 2005 at 09:28:57PM -0800, Kumar S
> wrote:
>
> > I am using a laptop and some of my .sql files
> with
> > insert statements (300K insert statements) take
> very
> > long time.
>
> How long is "very long"? Have you seen the
> "Performance Tips" chapter
> in the documentation, in particular the "Populating
> a Database" section?
>
>
http://www.postgresql.org/docs/8.0/interactive/populate.html
>
> Are you using transactions? Wrapping a lot of
> INSERTs in a transaction
> should be significantly faster than doing each
> INSERT as its own
> transaction.
>
> Have you considered using COPY instead of INSERT?
> COPY should be
> significantly faster than INSERT for bulk loads.
>
> > Could any one help to setup a background job where
> I
> > can start a job and forget until the next morning
> to
> > see that the job is finished.
> >
> > Should it be something like the following:
> > myserver$ psql -d mydb -d node2|\i /insert.sql &>
>
> See the psql documentation and your shell's
> documentation on how to run
> a background job and redirect its output; you might
> also need to use
> "nohup". For example, the following might work in
> Bourne-like shells
> (bash, sh, ksh, etc.):
>
> nohup psql -d mydb -f insert.sql > insert.log 2>&1 &
>
> --
> Michael Fuhr
> http://www.fuhr.org/~mfuhr/
>
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
From | Date | Subject | |
---|---|---|---|
Next Message | Sean Davis | 2005-03-06 18:19:51 | Re: background jobs |
Previous Message | Michael Fuhr | 2005-03-06 13:28:04 | Re: background jobs |