Re: 8.3beta1 testing on Solaris

From: "Jignesh K(dot) Shah" <J(dot)K(dot)Shah(at)Sun(dot)COM>
To: Gregory Stark <stark(at)enterprisedb(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org, pgsql-hackers(at)postgresql(dot)org
Subject: Re: 8.3beta1 testing on Solaris
Date: 2007-10-26 13:20:36
Message-ID: 4721E9A4.4040800@sun.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance


Hi George,

I have seen the 4M/sec problem first actually during an EAStress type
run with only 150 connections.

I will try to do more testing today that Tom has requested.

Regards,
Jignesh

Gregory Stark wrote:
> "Jignesh K. Shah" <J(dot)K(dot)Shah(at)Sun(dot)COM> writes:
>
>
>> CLOG data is not cached in any PostgreSQL shared memory segments and hence
>> becomes the bottleneck as it has to constantly go to the filesystem to get
>> the read data.
>>
>
> This is the same bottleneck you discussed earlier. CLOG reads are cached in
> the Postgres shared memory segment but only NUM_CLOG_BUFFERS are which
> defaults to 8 buffers of 8kb each. With 1,000 clients and the transaction rate
> you're running you needed a larger number of buffers.
>
> Using the filesystem buffer cache is also an entirely reasonable solution
> though. That's surely part of the logic behind not trying to keep more of the
> clog in shared memory. Do you have any measurements of how much time is being
> spent just doing the logical I/O to the buffer cache for the clog pages? 4MB/s
> seems like it's not insignificant but your machine is big enough that perhaps
> I'm thinking at the wrong scale.
>
> I'm really curious whether you see any benefit from the vxid read-only
> transactions. I'm not sure how to get an apples to apples comparison though.
> Ideally just comparing it to CVS HEAD from immediately prior to the vxid patch
> going in. Perhaps calling some function which forces an xid to be allocated
> and seeing how much it slows down the benchmark would be a good substitute.
>
>

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Sebastien FLAESCH 2007-10-26 13:23:49 Re: PostgreSQL 8.3, libpq and WHERE CURRENT OF
Previous Message Tom Lane 2007-10-26 13:09:42 Re: PostgreSQL 8.3, libpq and WHERE CURRENT OF

Browse pgsql-performance by date

  From Date Subject
Next Message Jignesh K. Shah 2007-10-26 13:25:02 Re: [HACKERS] 8.3beta1 testing on Solaris
Previous Message Jean-David Beyer 2007-10-26 13:04:43 Re: Bunching "transactions"