From: | Joe Maldonado <jmaldonado(at)webehosting(dot)biz> |
---|---|
To: | pgsql-admin(at)postgresql(dot)org |
Subject: | Performance tuning for copy in |
Date: | 2004-04-14 14:54:22 |
Message-ID: | 1081954461.3941.17.camel@joem |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-admin |
Hello,
Currently I can get no more than 40k records/second to be copied
in to postgres. This is also the case when running multiple
cocurrent copy in commands from different connections. It
seems linear in that 1 process will copy in at 40k/s and 2
will copy in at about 20k/s, etc.
I need to know whether I can get better performance from
the db with the hardware specified below. Changing from
mirrored to stripe RAID is not an option :( at this time
as is turning off fsync (which did not work much better).
-Joe Maldonado
Configuration:
PostgreSQL 7.4
configure --libdir=/usr/lib \
--includedir=/usr/include \
--bindir=/usr/bin \
--with-krb5=/usr/kerberos \
--with-openssl=/usr \
--enable-thread-safety \
--enable-debug
OS: RedHat 9
Drive Config:
sdb1: /pg_clog
sdb2: /pg_xlog
sdc1: /pg_data (RAID 1)
hdparm output shows average of 45MB/s
iostat shows fairly constant 10MB/s written to pg_data
and 5-8MB/s to WAL.
CPU: 2x 2.0G Xeon
From | Date | Subject | |
---|---|---|---|
Next Message | Bruno Wolff III | 2004-04-14 14:57:53 | Re: Real time replication of PG DBs accross two servers - |
Previous Message | Ben Kim | 2004-04-14 14:34:10 | Re: sequence value of the record just inserted. |