Re: driving postgres to achieve benchmark results similar to bonnie++

From: Mike Broers <mbroers(at)gmail(dot)com>
To: Kevin Grittner <kgrittn(at)gmail(dot)com>
Cc: Scott Whitney <scott(at)journyx(dot)com>, John Scalia <jayknowsunix(at)gmail(dot)com>, "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org>
Subject: Re: driving postgres to achieve benchmark results similar to bonnie++
Date: 2016-05-11 15:47:11
Message-ID: CAB9893gU960YWBPD0okrxtWrZviNp04d8V-N+7DRrJyK5-Skuw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Ok so I ran 6 parallel pgbench initializations at a relatively high scale
2500 on 6 different pgbench databases on the same server and was able to
push disk io to around 380MB/sec write with pretty low cpu wio (around
5-15%). Progress! As I hoped, I just haven't been pushing hard enough.

On Wed, May 11, 2016 at 10:16 AM, Mike Broers <mbroers(at)gmail(dot)com> wrote:

> I've set this parameter to 256 to test, still getting the same results.
> The only way I reliably see a spike in IO at all is on the pgbench
> initialization (still peaking around 110MB/sec writes), so I'm thinking
> about playing around with that or duplicating its approach with larger rows
> and running it from multiple sessions in different initialization databases
> on the same volume. If I cant push it further using that technique then
> there must be some dumb bottleneck in config I am overlooking.
>
>
>
> On Tue, May 10, 2016 at 3:24 PM, Kevin Grittner <kgrittn(at)gmail(dot)com> wrote:
>
>> On Tue, May 10, 2016 at 2:02 PM, Mike Broers <mbroers(at)gmail(dot)com> wrote:
>>
>> > If someone has an idea for how to set up pgbench to
>> > really push the io to prove out ssd potential, or a different
>> > script/approach that would be awesome.
>>
>> You might want to play with some large effective_io_concurrency
>> settings, starting around 256.
>>
>>
>> http://www.postgresql.org/message-id/CAHyXU0yiVvfQAnR9cyH=HWh1WbLRsioe=mzRJTHwtr=2azsTdQ@mail.gmail.com
>>
>> --
>> Kevin Grittner
>> EDB: http://www.enterprisedb.com
>> The Enterprise PostgreSQL Company
>>
>
>

In response to

Browse pgsql-admin by date

  From Date Subject
Next Message Campbell, Lance 2016-05-11 18:51:06 Re: Memory and Swap
Previous Message Mike Broers 2016-05-11 15:16:26 Re: driving postgres to achieve benchmark results similar to bonnie++