bulk data loading

From: "Potluri Srikanth" <spotluri(at)ismartpanache(dot)com>
To: <pgsql-performance(at)postgresql(dot)org>
Subject: bulk data loading
Date: 2008-04-08 03:41:47
Message-ID: 41583.1207626107@ismartpanache.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

<HTML>
Hi all,<br>
<br>
I need to do a bulk data loading around 704GB (log file size) at present&nbsp; in 8 hrs (1 am - 9am). The data file size may increase 3 to 5 times in future.<br>
<br>
Using COPY it takes 96 hrs to finish the task.<br>
What is the best way to do it ?<br>
<br>
HARDWARE: SUN THUMPER/ RAID10<br>
OS : SOLARIS 10.<br>
DB: Greenplum/Postgres<br>
<br>
<br>
Regards,
<br>
Srikanth k Potluri
<br>
+63 9177444783(philippines) <br>
<br>
<span style="font-weight: bold;"><br>
</span><blockquote style="border-left: 2px solid rgb(245, 245, 245); margin-left: 5px; margin-right: 0px; padding-left: 5px; padding-right: 0px;"><br>

</blockquote><BR></HTML>

Attachment Content-Type Size
unknown_filename text/html 668 bytes

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message bitaoxiao 2008-04-08 03:50:51 Re: bulk insert performance problem
Previous Message Chris 2008-04-08 03:32:56 Re: bulk insert performance problem