From: | Martin Gainty <mgainty(at)hotmail(dot)com> |
---|---|
To: | <bbeyer(at)purdue(dot)edu>, <pgsql-general(at)postgresql(dot)org> |
Subject: | Re: Possible limit on transaction size? |
Date: | 2008-09-13 13:15:38 |
Message-ID: | BLU142-W11835CF59CE413FBAD2462AE500@phx.gbl |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
Good Morning Brian-
sounds like a very nasty bug first discovered in 07
http://archives.postgresql.org/pgsql-bugs/2007-04/msg00075.php
the bug was supposed to be eradicated post 8.3.3
which version are you using which exhibits this behaviour?
thanks/
Martin
______________________________________________
Disclaimer and confidentiality note
Everything in this e-mail and any attachments relates to the official business of Sender. This transmission is of a confidential nature and Sender does not endorse distribution to any party other than intended recipient. Sender does not necessarily endorse content contained within this transmission.
> Date: Mon, 8 Sep 2008 09:17:49 -0400
> From: bbeyer(at)purdue(dot)edu
> To: pgsql-general(at)postgresql(dot)org
> Subject: [GENERAL] Possible limit on transaction size?
>
> Hello,
>
> I was curious if there was a known size limit for Postgres transactions. In
> order to import data into my database, my Java application begins a transaction,
> imports the data (into several different tables), and then commits the
> transaction on success. It works great on small data sets, but on the large
> ones, it doesn't work so well.
>
> About 150 million records into the import process, I get the following error:
>
> ERROR: lock AccessShareLock on object 51533/51769/0 is already held
> CONTEXT: SQL statement "INSERT INTO table_name (col1, col2, col3, col4) VALUES
> (val1, val2, val3, val4)"
>
> PL/pgSQL function "create_import" line 19 at SQL statement
> STATEMENT: select * from create_import($1,$2,$3,$4,$5,$6) as result
>
> I know my server can handle this much data (24GB RAM, 2 TB SAS disks, etc.), but
> it doesn't seem like Postgres likes the large transactions.
>
> Any thoughts?
>
> Thank you for your time,
>
> Brian Beyer
> Purdue University
> bbeyer(at)purdue(dot)edu
>
> --
> Sent via pgsql-general mailing list (pgsql-general(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general
_________________________________________________________________
See how Windows Mobile brings your life together—at home, work, or on the go.
http://clk.atdmt.com/MRT/go/msnnkwxp1020093182mrt/direct/01/
From | Date | Subject | |
---|---|---|---|
Next Message | Martin Gainty | 2008-09-13 13:44:31 | Re: Getting rows in a very specific order |
Previous Message | Patrik Strömstedt | 2008-09-13 13:07:23 | Restore filesystem backup |