From: | gmb <gmbouwer(at)gmail(dot)com> |
---|---|
To: | pgsql-sql(at)postgresql(dot)org |
Subject: | Re: High memory usage / performance issue ( temp tables ? ) |
Date: | 2014-08-18 05:33:18 |
Message-ID: | 1408339998171-5815175.post@n5.nabble.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-sql |
Thanks for the replies.
I tried a couple of alternative methods over the weekend in the hope of
improving performance, but unfortunately to no avail.
One of these was to have the processing of the 500K xml files shared between
multiple threads ( multiple connections ).
In an attempt to "force" the dropping of the temp tables , each thread
creates its own connection, run the function with XML payload and the
disconnects.
The impression I got was that the avg time per transaction still increases
as the process progresses.
My one concern with this method was locking , which I'm unfortunately quite
unfamiliar with.
Is it possible that locking could be a key problem when following this
multi-thread approach ?
Regards
gmb
--
View this message in context: http://postgresql.1045698.n5.nabble.com/High-memory-usage-performance-issue-temp-tables-tp5815108p5815175.html
Sent from the PostgreSQL - sql mailing list archive at Nabble.com.
From | Date | Subject | |
---|---|---|---|
Next Message | Pavel Stehule | 2014-08-18 06:44:27 | Re: High memory usage / performance issue ( temp tables ? ) |
Previous Message | Pavel Stehule | 2014-08-17 19:55:49 | Re: High memory usage / performance issue ( temp tables ? ) |