Re: Is there a meaningful benchmark?

On Fri, Mar 20, 2009 at 9:55 AM, Will Rutherdale (rutherw)
<rutherw(at)cisco(dot)com> wrote:
> You have a point, as do a lot of the other folks.
>
> However, keeping the KISS principle in mind, you can create a benchmark
> that simply sets up a sample database and forks off a bunch of processes
> to do random updates for an hour, say.  Dead simple.
>
> In fact, it's so simple that I've already written the code and have it
> running against Postgres now.  A Perl DBI script runs in a loop
> updating, and later prints out the number of transactions it completed
> in the given time frame.  At the end I just tally up the numbers and I
> have the Will Rutherdale benchmark number for Postgres.  It will give me
> a simple number in units of transactions per second.

Just keep in mind that a single thread updating the database is not a
very realistic benchmark. Databases tend to not get interesting until
there are dozens to hundreds of threads running against it at the same
time.