Re: Filesystem benchmarking for pg 8.3.3 server

From: "Scott Carey" <scott(at)richrelevance(dot)com>
To: david(at)lang(dot)hm
Cc: "Ron Mayer" <rm_pg(at)cheapcomplexdevices(dot)com>, "Greg Smith" <gsmith(at)gregsmith(dot)com>, Henrik <henke(at)mac(dot)se>, pgsql-performance(at)postgresql(dot)org
Subject: Re: Filesystem benchmarking for pg 8.3.3 server
Date: 2008-08-13 02:52:10
Message-ID: a1ec7d000808121952g14c5b646t1009ed2009ab47e4@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

I'm not an expert on which and where -- its been a while since I was exposed
to the issue. From what I've read in a few places over time (
storagereview.com, linux and windows patches or knowledge base articles), it
happens from time to time. Drives usually get firmware updates quickly.
Drivers / Controller cards often take longer to fix. Anyway, my anecdotal
recollection was with a few instances of this occuring about 4 years ago and
manefesting itself with complaints on message boards then going away. And
in general some searching around google indicates this is a problem more
often drivers and controllers than drives themselves.

I recall some cheap raid cards and controller cards being an issue, like the
below:
http://www.fixya.com/support/t163682-hard_drive_corrupt_every_reboot

And here is an example of an HP Fiber Channel Disk firmware bug:
HS02969 28SEP07<http://h50025.www5.hp.com/ENP5/Admin/UserFileAdmin/EV/23560/File/Hotstuffs.pdf>

Title
: OPN FIBRE CHANNEL DISK FIRMWARE

Platform
: S-Series & NS-Series only with FCDMs

Summary
:
HP recently discovered a firmware flaw in some versions of 72,
146, and 300 Gigabyte fibre channel disk devices that shipped in late 2006
and early 2007. The flaw enabled the affected disk devices to inadvertently
cache write data. In very rare instances, this caching operation presents an
opportunity for disk write operations to be lost.

Even ext3 doesn't default to using write barriers at this time due to
performance concerns:
http://lwn.net/Articles/283161/

On Tue, Aug 12, 2008 at 6:33 PM, <david(at)lang(dot)hm> wrote:

> On Tue, 12 Aug 2008, Ron Mayer wrote:
>
> Scott Carey wrote:
>>
>>> Some SATA drives were known to not flush their cache when told to.
>>>
>>
>> Can you name one? The ATA commands seem pretty clear on the matter,
>> and ISTM most of the reports of these issues came from before
>> Linux had write-barrier support.
>>
>
> I can't name one, but I've seen it mentioned in the discussions on
> linux-kernel several times by the folks who are writing the write-barrier
> support.
>
> David Lang
>
>
>
> --
> Sent via pgsql-performance mailing list (pgsql-performance(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-performance
>

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Ron Mayer 2008-08-13 04:28:32 Re: Filesystem benchmarking for pg 8.3.3 server
Previous Message david 2008-08-13 01:33:08 Re: Filesystem benchmarking for pg 8.3.3 server