Re: File Systems Compared

At 10:40 AM 12/6/2006, Brian Wipf wrote:

All tests are with bonnie++ 1.03a

Main components of system:
16 WD Raptor 150GB 10000 RPM drives all in a RAID 10
ARECA 1280 PCI-Express RAID adapter with 1GB BB Cache (Thanks for the
recommendation, Ron!)
32 GB RAM
Dual Intel 5160 Xeon Woodcrest 3.0 GHz processors
OS: SUSE Linux 10.1

>xfs (with write cache disabled on disks):
>/usr/local/sbin/bonnie++ -d bonnie/ -s 64368:8k
>Version 1.03 ------Sequential Output------ --Sequential Input-
>--Random-
> -Per Chr- --Block-- -Rewrite- -Per Chr- --
> Block-- --Seeks--
>Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %
>CP /sec %CP
>hulk4 64368M 90621 99 283916 35 105871 11 88569 97
>433890 23 644.5 0
> ------Sequential Create------ --------Random
>Create--------
> -Create-- --Read--- -Delete-- -Create-- --
> Read--- -Delete--
> files /sec %CP /sec %CP /sec %CP /sec %CP /sec %
> CP /sec %CP
> 16 28435 95 +++++ +++ 28895 82 28523 91 +++++
> ++ + 24369 86
>hulk4,64368M,
>90621,99,283916,35,105871,11,88569,97,433890,23,644.5,0,16,28435,95,++
>+++,+++,28895,82,28523,91,+++++,+++,24369,86
>
>xfs (with write cache enabled on disks):
>/usr/local/sbin/bonnie++ -d bonnie -s 64368:8k
>Version 1.03 ------Sequential Output------ --Sequential Input-
>--Random-
> -Per Chr- --Block-- -Rewrite- -Per Chr- --
> Block-- --Seeks--
>Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %
>CP /sec %CP
>hulk4 64368M 90861 99 348401 43 131887 14 89412 97
>432964 23 658.7 0
> ------Sequential Create------ --------Random
>Create--------
> -Create-- --Read--- -Delete-- -Create-- --
> Read--- -Delete--
> files /sec %CP /sec %CP /sec %CP /sec %CP /sec %
> CP /sec %CP
> 16 28871 90 +++++ +++ 28923 91 30879 93 +++++
> ++ + 28012 94
>hulk4,64368M,
>90861,99,348401,43,131887,14,89412,97,432964,23,658.7,0,16,28871,90,++
>+++,+++,28923,91,30879,93,+++++,+++,28012,94
Hmmm. Something is not right. With a 16 HD RAID 10 based on 10K
rpm HDs, you should be seeing higher absolute performance numbers.

Find out what HW the Areca guys and Tweakers guys used to test the 1280s.
At LW2006, Areca was demonstrating all-in-cache reads and writes of
~1600MBps and ~1300MBps respectively along with RAID 0 Sustained
Rates of ~900MBps read, and ~850MBps write.

Luke, I know you've managed to get higher IO rates than this with
this class of HW. Is there a OS or SW config issue Brian should
closely investigate?

Ron Peacetree