Re: Is there a meaningful benchmark?

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: "Will Rutherdale (rutherw)" <rutherw(at)cisco(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Is there a meaningful benchmark?
Date: 2009-03-20 16:06:29
Message-ID: 14357.1237565189@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

"Will Rutherdale (rutherw)" <rutherw(at)cisco(dot)com> writes:
> However, keeping the KISS principle in mind, you can create a benchmark
> that simply sets up a sample database and forks off a bunch of processes
> to do random updates for an hour, say. Dead simple.

Indeed, and more than likely dead useless. The only benchmark that
really counts is one's live application, which is probably not
update-only and probably has a fairly non-random update pattern too.

What people have been trying to point out to you is that you can
certainly measure *something* with a benchmark test that has no thought
behind it, but it's not clear whether the numbers you come up with will
have any real-world value.

regards, tom lane

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Greg Smith 2009-03-20 16:47:42 Re: Is there a meaningful benchmark?
Previous Message Scott Marlowe 2009-03-20 16:00:45 Re: Is there a meaningful benchmark?