Re: Is there a meaningful benchmark?

I'm having trouble with the tweakers reference below.

I was hoping to see something where hardware platform is held constant while RDBMS is varied, but it seems to be just the opposite. Or maybe I didn't read the article the right way.

-Will

-----Original Message-----
From: Scott Marlowe [mailto:scott(dot)marlowe(at)gmail(dot)com]
Sent: 19 March 2009 17:36
To: Dann Corbit
Cc: Will Rutherdale (rutherw); pgsql-general(at)postgresql(dot)org
Subject: Re: [GENERAL] Is there a meaningful benchmark?

On Thu, Mar 19, 2009 at 3:16 PM, Dann Corbit <DCorbit(at)connx(dot)com> wrote:
> Here are some benchmark figures:
> http://tweakers.net/reviews/657/6

SNIP

> My opinion:
> Most benchmarks are run by someone with an axe to grind.  I never
> believe them.

Generally I agree with that sentiment. However, it's interesting that
the guys at tweakers.net run (or ran?) their chat board on mysql, and
expected it to win. They certainly didn't expect the kind of stomping
that postgresql gave to mysql, so I look at that benchmark as a
"statement against interest" kind of thing. They were genuinely
surprised that postgresql didn't just win, but behaved much much
better than mysql under heavier loads.