Slow Inserts Leads To Unable To Dump

From: "Frank Morton" <fmorton(at)base2inc(dot)com>
To: <pgsql-sql(at)postgreSQL(dot)org>
Subject: Slow Inserts Leads To Unable To Dump
Date: 1999-05-10 13:17:05
Message-ID: 041c01be9ae7$668ea5a0$8355e5ce@base2inc.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

Remember the thread last week about slow inserts? I still
have more to do, but basically I ended up waiting about 7
DAYS to insert 150,000 rows into a single table.

Now that that is done, I thought I should dump the database
before doing any more to save those 7 days if I mess up.
After processing 18 HOURS doing the "pg_dump -d", it ran
out of memory and quit. Are there tools to do this differently,
that is, not requiring the system to do a SELECT on the
whole table first? Just dump it? (I did try pg_dump without
-d but stopped it after an hour or so)

I am getting concerned that I can't really use postgreSQL
for large databases. Sure, some have built large databases,
but have any of you ever had to dump and restore them?
What happens when an update requires that? I think some
have reported 1,000,000 rows databases. By my calculation,
if you could get it to dump, it would take my database 46 DAYS
to reload if I get to that size. Maybe "copy" will help, but now
I'm more concerned about being totally unable to "dump."

I really like postgreSQL and think everyone working on it doing
great work. But, I need to hear some comments from all of you
confirming what I am seeing or telling me I am missing something.

Thanks to all, Frank

In response to

Browse pgsql-sql by date

  From Date Subject
Next Message Matthias Seiferth 1999-05-10 15:23:02 Retrieving column names and table names of a database
Previous Message Ana Roizen 1999-05-10 12:47:37 Having problem retrieving huge? table