From: | "dentfirst13(at)earthlink(dot)net" <dentfirst13(at)earthlink(dot)net> |
---|---|
To: | sing_vivek(at)yahoo(dot)com, pgsql-performance(at)postgresql(dot)org |
Subject: | Re: Insertion puzzles |
Date: | 2004-11-14 02:00:48 |
Message-ID: | 102570-22004110142048396@M2W072.mail2web.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-performance |
Vivek,
I ran into the exact same problem you did. I tried many, many changes to
the conf file, I tried O.S. tuning but performance stunk. I had a fairly
simple job that had a lot of updates and inserts that was taking 4 1/2
hours. I re-wrote it to be more "Postgres friendly" - meaning less
database updates and got it down under 2 1/2 hours (still horrible).
Understand, the legacy non-postgres ISAM db took about 15 minutes to
perform the same task. I assumed it was a system problem that would go
away when we upgraded servers but it did not. I converted to MySQL and the
exact same java process takes 5 minutes! Postgres is a great DB for some,
for our application it was not - you may want to consider other products
that are a bit faster and do not require the vacuuming of stale data.
Original Message:
-----------------
From: vivek singh sing_vivek(at)yahoo(dot)com
Date: Sat, 13 Nov 2004 03:26:09 -0800 (PST)
To: pgsql-performance(at)postgresql(dot)org
Subject: [PERFORM] Insertion puzzles
Hello to all,
I am new to this group and postgresql. I am working on
a project which uses postgresql and project is time
critical. We did all optimization in our project but
postgresql seems to be a bottle-neck. To solve this we
run the database operations in a different thread. But
still, with large volume of data in database the
insert operation becomes very slow (ie. to insert 100
records in 5 tables, it takes nearly 3minutes).
vacuum analyze helps a bit but performance improvement
is not much.
We are using the default postgres setting (ie. didn't
change postgresql.conf).
One more point: When we try to upload a pg_dump of
nearly 60K records for 7 tables it took more than
10hrs.
System config:
Redhat Linux7.2
RAM: 256MB
postgres: 7.1.3
connection: ODBC
Thanks to all, please consider it even if it is silly
doubt.
Vivek
__________________________________
Do you Yahoo!?
Check out the new Yahoo! Front Page.
www.yahoo.com
---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo(at)postgresql(dot)org
--------------------------------------------------------------------
mail2web - Check your email from the web at
http://mail2web.com/ .
From | Date | Subject | |
---|---|---|---|
Next Message | Dave Cramer | 2004-11-15 00:45:56 | Re: Insertion puzzles |
Previous Message | Josh Berkus | 2004-11-14 01:36:12 | Re: Insertion puzzles |