Re: Improve performance for writing

From: Charles Gomes <charlesrg(at)outlook(dot)com>
To: Markus Innerebner <markus(dot)innerebner(at)inf(dot)unibz(dot)it>, "pgsql-performance(at)postgresql(dot)org" <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Improve performance for writing
Date: 2012-12-27 14:45:38
Message-ID: BLU002-W186694D3F0E283029B6501DAB380@phx.gbl
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Markus,

Have you looked over here:
http://www.postgresql.org/docs/9.2/static/populate.html

----------------------------------------
> From: markus(dot)innerebner(at)inf(dot)unibz(dot)it
> Subject: [PERFORM] Improve performance for writing
> Date: Thu, 27 Dec 2012 14:10:40 +0100
> To: pgsql-performance(at)postgresql(dot)org
>
> Hello
>
> please do not consider this email as an yet another question how to speed up writing.
>
> The situation is different:
>
> My algorithm stores after the computation the result as tuples in a DB.
> The tuples in addition to normal values (e.g. a,b) , contains sql statements that fetch values (for instance the geometry attribute) from another table (e.g. orig_table).
>
> e.g.
>
> INSERT INTO dest_table (
> Select a,b, s.geometry,s.length from orig_table s where s.id=?
> )
>
> The number of inserts depends on the size of the result and vary from 10,000 to 1,000,000.
>
> My question is: how can I speed up such inserts?
>
> Only COPY statements want work, since I need additional values
> Insert statements takes long time (even if using Bulk)
>
> What do you suggest me in such a situation?
>
> Would it be better to perform?
> - first use COPY to store values in new table
> - second update the new table with values from origin table
>
>
> thanks for your hints / suggestions
>
> cheers Markus
>
> --
> Sent via pgsql-performance mailing list (pgsql-performance(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-performance

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Charles Gomes 2012-12-27 16:16:26 Re: Performance on Bulk Insert to Partitioned Table
Previous Message Markus Innerebner 2012-12-27 13:10:40 Improve performance for writing