Re: Some pgbench results

Hi,

> Did you re-initialize the test pgbench database between runs?
> I get weird results otherwise since some integers gets overflowed in the
> test (it doesn't complete the full 10000 transactions after the first run).

No, I didn't. The reason is that I noticed that the first run is
always MUCH faster. My initial runs if I reinit pgbench and run again
will always hover around 900-970 tps for xfs. And I didn't need this
as a real performance test, it was a side effect of a load test I was
doing on the server. Also, pgbench isn't close to the load I'll see on
my server (web application which will be mostly read)

> Could you please tell me what stripe size you have on the raid system?
> Could you also share the mkfs and mount options on each filesystem you
> tried?

RAID stripe size of 256K.
File system creation:
xfs: mkfs -t xfs -l size=64m /dev/md0
jfs: mkfs -t jfs /dev/md0

Mount for xfs with -o noatime,nodiratime,logbufs=8
jfs: -o noatime,nodiratime

> A hint on using a raided ext3 system is to use whole block device
> instead of partitions to align the data better and use data=journal with
> a big journal. This might seem counter-productive at first (it did to
> me) but I increased my throughput a lot when using this.

Thanks for the advice! Actually, the RAID 10 I have is mounted as
/var/lib/pgsql, so it's ONLY for postgres data, and the pg_xlog
directory is mounted on another disk.

> My filesystem parameters are calculated like this:
> stripe=256 # <- 256k raid stripe size
> bsize=4 # 4k blocksize
> bsizeb=$(( $bsize * 1024 )) # in bytes
> stride=$(( $stripe / $bsize ))
>
> mke2fs -b $bsizeb -j -J size=400 -m 1 -O sparse_super \
> -T largefile4 -E stride=$stride /dev/sdb
>
> Mounted with: mount -t ext3 -o data=journal,noatime /dev/sdb /mnt/test8

That's an interesting thing to try, though because of other things I
want, I prefer xfs or jfs anyway. I will have an extreme number of
schemas and files, which make high demands on the directory structure.
My tests showed me that ext3 doesn't cope with many files in
directories very well. With xfs and jfs I can create 500K files in one
directory in no time (about 250 seconds), with ext3 it start to crawl
after about 30K files.

> I'm a little surprised that I can get more pgbench performance out of my
> system since you're using 10K scsi disks. Please try the above settings
> and see if it helps you...
>
> I've not run so many tests yet, I'll do some more after the weekend...

Please share the results. It's very interesting...

Bye,

Guy.

BTW, one thing I also tested is a software RAID0 over two RAID5 SATA
arrays. Total disk count in this is 15. The read performance was
really good. The write performance (as expected) not so great. But
that was just a test to get a feeling of the speed. This RAID5 system
is only used for file storage, not database.

--
Family management on rails: http://www.famundo.com - coming soon!
My development related blog: http://devblog.famundo.com