Re: Is it possible to have a "fast-write" Index?

From: Jim Nasby <Jim(dot)Nasby(at)BlueTreble(dot)com>
To: deavid <deavidsedice(at)gmail(dot)com>, Gavin Flower <GavinFlower(at)archidevsys(dot)co(dot)nz>, <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Is it possible to have a "fast-write" Index?
Date: 2015-06-11 21:23:46
Message-ID: 5579FC62.1030804@BlueTreble.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 6/5/15 6:54 PM, deavid wrote:
>
> So the problem is: i see a low iowait, and CPU time for one core is at
> 80-90% most of the time. I can buy more ram, better disks, or cpu's with
> more cores. But one cpu core would have more-or-less the same speed no
> matter how much money you invest.
>
> When someone wants a delayed-write index is similar to setting
> "synchronous_commit = off". We want to give an OK to the backend as
> soon as is possible and do this work in background. But we also want
> some reliability against crashes.
>
> Also, if the task is done in background it may be done from other
> backend, so probably several indexes could be packed at once using
> different backend processes. We could use the entire cpu if our index
> writes aren't tied to the session who wrote the row.

Something that might help here would be doing the index maintenance in
parallel via background workers. There's now enough parallelism
infrastructure that it shouldn't be too hard to hack up a quick test of
that.
--
Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX
Data in Trouble? Get it in Treble! http://BlueTreble.com

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Geoghegan 2015-06-11 21:26:44 Re: 9.5 release notes
Previous Message Robert Haas 2015-06-11 21:17:54 Re: 9.5 release notes