Re: tracking scripts...

From: Joey Quinn <bjquinniii(at)gmail(dot)com>
To: Rémi Cura <remi(dot)cura(at)gmail(dot)com>
Cc: PostgreSQL General <pgsql-general(at)postgresql(dot)org>
Subject: Re: tracking scripts...
Date: 2013-11-26 17:11:22
Message-ID: CAG5XHY=C0mt2WJT4LvQg6sG3zyas1xVW=ieUMVZqbkNsuvUoAg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

The queries themselves are written like so:

update ipv4_table set country='xx' where ipv4 between 'xxx.xxx.xxx.xxx' and
'xxx.xxx.xxx.xxx';

There are 127k lines like that (each with a different range and the
appropriate country code). Each is terminated with a semi-colon. Does that
make them individual transactions in postgres or not? (postgres newbie
here). Is there something else I need to do for them to be treated like
separate transactions?

On Tue, Nov 26, 2013 at 11:16 AM, Rémi Cura <remi(dot)cura(at)gmail(dot)com> wrote:

> Now it's too late,
> but maybe you could allow to not use a single transaction ( but instead
> 127k transactions).4
>
> Then at the end of every transaction you could print something in gui
> (print for pgscript, raise for plpgsql) or execute a command to write in a
> file (copy for instance).
> It would also be in the log, but not so clear.
>
> Cheers,
>
> Rémi-C
>
>
> 2013/11/26 Joey Quinn <bjquinniii(at)gmail(dot)com>
>
>> I have a fairly large table (4.3 billion rows) that I am running an
>> update script on (a bit over 127 thousand individual update queries). I am
>> using the gui. It has been running for about 24 hours now. Is there any
>> good way to gauge progress (as in, how many of the individual update
>> queries have finished)?
>>
>>
>>
>

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Vick Khera 2013-11-26 17:13:39 Re: tracking scripts...
Previous Message Vick Khera 2013-11-26 16:20:11 Re: tracking scripts...