From: | Tim Kane <tim(dot)kane(at)gmail(dot)com> |
---|---|
To: | <chris(at)chriscurvey(dot)com> |
Cc: | pgsql-general General <pgsql-general(at)postgresql(dot)org> |
Subject: | Re: ON_ERROR_EXIT and interactive mode (or, how to force interactive mode off) |
Date: | 2013-12-30 14:10:38 |
Message-ID: | CEE72EDD.537AA%tim.kane@gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
Thanks Chris. I didn’t realise psycopg2 had a COPY interface, that’s quite
handy. I’ll have a play, cheers.
Tim
From: Chris Curvey <chris(at)chriscurvey(dot)com>
Reply-To: <chris(at)chriscurvey(dot)com>
Date: Friday, 27 December 2013 21:18
To: Tim Kane <tim(dot)kane(at)gmail(dot)com>
Cc: pgsql-general General <pgsql-general(at)postgresql(dot)org>
Subject: Re: [GENERAL] ON_ERROR_EXIT and interactive mode (or, how to force
interactive mode off)
On Fri, Dec 27, 2013 at 7:30 AM, Tim Kane <tim(dot)kane(at)gmail(dot)com> wrote:
> HI all,
>
> I have a fairly complex python script which calls a number of ‘psql’ sessions
> via a subprocess to perform bulk load operations.
> The bulk loads are generated on the fly, and are written directly to the stdin
> of the subprocess.
>
>
> I would like to rely on the ON_ERROR_STOP=1 functionality to force the process
> to exit with an error code – however, psql rightly believes the process it is
> operating under is an interactive one – since it is receiving its input from
> stdin.
>
> For performance (and disk) reasons, I’d rather not have to rely on writing my
> input to a file, before passing it to psql with –f
>
>
> This part of the man page gave me hope…
>
>
>
>> -f filename
>> --file filename
>> Use the file filename as the source of commands instead of reading commands
>> interactively. After the file is processed, psql terminates. This is in many
>> ways equivalent to the internal command \i.
>> If filename is - (hyphen), then standard input is read.
>> Using this option is subtly different from writing psql < filename. In
>> general, both will do what you expect, but using -f enables some nice
>> features such as error messages with line numbers. There is also a slight
>> chance that using this option will reduce the start-up overhead. On the other
>> hand, the variant using the shell's input redirection is (in theory)
>> guaranteed to yield exactly the same output that you would have gotten had
>> you entered everything by hand.
>
>
> Eg:
> psql –v ON_ERROR_STOP=1 –f -
>
> But it seems this is still understood by psql to be an interactive session,
> and fails to exit the process on an error.
>
>
> Is there any way to force psql to read from stdin, in a non-interactive
> manner? (that is, to ensure it exits the process on an error condition?)
>
>
> Thanks for any advice
>
> Tim
>
>
I'm afraid I can't answer your question directly (see my sig), but if you're
already using Python to create the files, would you be better off using
psycopg2's COPY interfaces? If use just connect directly from Python to
Postgres, I would think that your success and error handling would be much
simpler.
http://initd.org/psycopg/docs/usage.html#using-copy-to-and-copy-from
--
I asked the Internet how to train my cat, and the Internet told me to get a
dog.
From | Date | Subject | |
---|---|---|---|
Next Message | Janek Sendrowski | 2013-12-30 14:14:00 | bulk insert unique contraint |
Previous Message | Leonardo M. Ramé | 2013-12-30 14:02:20 | Re: AutoVacuum Daemon |