What constitutes "reproducible" numbers from pgbench?

From: <Holger(dot)Friedrich-Fa-Trivadis(at)it(dot)nrw(dot)de>
To: <pgsql-general(at)postgresql(dot)org>
Subject: What constitutes "reproducible" numbers from pgbench?
Date: 2015-04-21 14:21:58
Message-ID: C5DBACC6DCC7604C9E4875FD9C7968B112D90C5000@ITXS01EVS.service.it.nrw.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hello list,

Exactly what constitutes "reproducible" values from pgbench? I keep getting a range between 340 tps and 440 tps or something like that using the same command line on the same machine. Is that reproducible enough?

The docs state that one should verify that the numbers are reproducible, so I repeat any test run ten times before believing the results. I've tried increasing the test duration (-T) from one minute to five minutes, then turning off autovacuum (in postgresql.conf) as recommended by the docs, but the range of results is not getting any narrower. So what does "reproducible" mean as applied to pgbench?

Obviously I could be doing something wrong, such as missing some vital configuration option...

Thanks in advance for any insights.

Cheers,
Holger Friedrich

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Qingqing Zhou 2015-04-21 17:17:01 Re: What constitutes "reproducible" numbers from pgbench?
Previous Message Craig Ringer 2015-04-21 02:11:11 Re: monitoring bdr nodes