Re: a question about Direct I/O and double buffering

From: "Jim C(dot) Nasby" <jim(at)nasby(dot)net>
To: Erik Jones <erik(at)myemma(dot)com>
Cc: Mark Lewis <mark(dot)lewis(at)mir3(dot)com>, Xiaoning Ding <dingxn(at)cse(dot)ohio-state(dot)edu>, pgsql-performance(at)postgresql(dot)org
Subject: Re: a question about Direct I/O and double buffering
Date: 2007-04-18 18:07:59
Message-ID: 20070418180758.GW72669@nasby.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Thu, Apr 05, 2007 at 03:10:43PM -0500, Erik Jones wrote:
> Nope. What we never tracked down was the factor of 10 drop in
> database transactions, not disk transactions. The write volume was
> most definitely due to the direct io setting -- writes are now being
> done in terms of the system's block size where as before they were
> being done in terms of the the filesystem's cache page size (as it's
> in virtual memory). Basically, we do so many write transactions that
> the fs cache was constantly paging.

Did you try decreasing the size of the cache pages? I didn't realize
that Solaris used a different size for cache pages and filesystem
blocks. Perhaps the OS was also being too aggressive with read-aheads?

My concern is that you're essentially leaving a lot of your memory
unused this way, since shared_buffers is only set to 1.6G.

BTW, did you ever increase the parameter that controls how much memory
Solaris will use for filesystem caching?
--
Jim Nasby jim(at)nasby(dot)net
EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Dave Dutcher 2007-04-18 18:09:57 Re: Basic Q on superfluous primary keys
Previous Message Tom Lane 2007-04-18 17:47:37 Re: Foreign Key Deadlocking