Re: posting tree compression (WAS: Proposal: fix range queries in btree_gin)

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Claudio Freire <klaussfreire(at)gmail(dot)com>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, Alexander Korotkov <aekorotkov(at)gmail(dot)com>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: posting tree compression (WAS: Proposal: fix range queries in btree_gin)
Date: 2014-03-31 21:37:21
Message-ID: 25778.1396301841@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Claudio Freire <klaussfreire(at)gmail(dot)com> writes:
> On Mon, Mar 31, 2014 at 6:21 PM, Robert Haas <robertmhaas(at)gmail(dot)com> wrote:
>> On Fri, Mar 28, 2014 at 11:30 AM, Alexander Korotkov
>> <aekorotkov(at)gmail(dot)com> wrote:
>>> after reading Heikki Linnakangas presentation about GIN from Nordic PGDay, I
>>> figure out that btree_gin became much more attractive.
>>> http://hlinnaka.iki.fi/presentations/NordicPGDay2014-GIN.pdf

>> This is a mighty interesting presentation. Could the posting tree
>> compression described on the "posting tree page format" slides (pp.
>> 16-17, I think) be used for btree also? Would we get similar
>> benefits? How much more expensive are updates with the new system?

> I'd believe so, but it can make updates quite complicated.

> I was going to take a stab at prefix-compression in b-tree, I could
> explore delta compression of the tids as well.

Prefix compression definitely seems like it could be a win thanks to
index ordering (although note that on little-endian machines, you need to
be careful about which end of an integer is the "prefix"). I'm pretty
dubious about tid deltas being useful for btree, though. GIN has the
luxury of being able to sort a lot of tids into tid order, btree doesn't.

regards, tom lane

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Claudio Freire 2014-03-31 21:53:14 Re: posting tree compression (WAS: Proposal: fix range queries in btree_gin)
Previous Message Claudio Freire 2014-03-31 21:29:06 Re: posting tree compression (WAS: Proposal: fix range queries in btree_gin)