Optimizing large data loads

From: "John Wells" <jb(at)sourceillustrated(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Optimizing large data loads
Date: 2005-08-05 12:25:18
Message-ID: 57890.66.192.236.118.1123244718.squirrel@devsea.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi guys,

We have a Java process that uses Hibernate to load approximately 14 GB of
data. One a dual-proc 2.4 GHZ Xeon with 2048 MB RAM, it's currently
taking over 13 hours to load (PostgreSQL 7.4.8). We're flushing from
hibernate every 50 records.

I've turned fsync to false in postgresql.conf, and we've turned autocommit
off in our code. Is there anything else I could try to temporarily speed
up inserts?

Thanks very much for your help.

John

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Roman Neuhauser 2005-08-05 12:34:22 Re: Cursor Issue??
Previous Message Thomas Pundt 2005-08-05 12:19:27 Re: DNS vs /etc/hosts