Re: High memory usage / performance issue ( temp tables ? )

From: gmb <gmbouwer(at)gmail(dot)com>
To: pgsql-sql(at)postgresql(dot)org
Subject: Re: High memory usage / performance issue ( temp tables ? )
Date: 2014-08-18 05:33:18
Message-ID: 1408339998171-5815175.post@n5.nabble.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

Thanks for the replies.

I tried a couple of alternative methods over the weekend in the hope of
improving performance, but unfortunately to no avail.
One of these was to have the processing of the 500K xml files shared between
multiple threads ( multiple connections ).
In an attempt to "force" the dropping of the temp tables , each thread
creates its own connection, run the function with XML payload and the
disconnects.
The impression I got was that the avg time per transaction still increases
as the process progresses.

My one concern with this method was locking , which I'm unfortunately quite
unfamiliar with.

Is it possible that locking could be a key problem when following this
multi-thread approach ?

Regards

gmb

--
View this message in context: http://postgresql.1045698.n5.nabble.com/High-memory-usage-performance-issue-temp-tables-tp5815108p5815175.html
Sent from the PostgreSQL - sql mailing list archive at Nabble.com.

In response to

Responses

Browse pgsql-sql by date

  From Date Subject
Next Message Pavel Stehule 2014-08-18 06:44:27 Re: High memory usage / performance issue ( temp tables ? )
Previous Message Pavel Stehule 2014-08-17 19:55:49 Re: High memory usage / performance issue ( temp tables ? )