Re: BitmapHeapScan streaming read user and prelim refactoring

From: Melanie Plageman <melanieplageman(at)gmail(dot)com>
To: Heikki Linnakangas <hlinnaka(at)iki(dot)fi>
Cc: Andres Freund <andres(at)anarazel(dot)de>, Pg Hackers <pgsql-hackers(at)postgresql(dot)org>, Thomas Munro <thomas(dot)munro(at)gmail(dot)com>, Nazir Bilal Yavuz <byavuz81(at)gmail(dot)com>
Subject: Re: BitmapHeapScan streaming read user and prelim refactoring
Date: 2024-03-23 00:26:07
Message-ID: 20240323002607.abegehmmjyxrnmm2@liskov
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Mar 22, 2024 at 08:22:11PM -0400, Melanie Plageman wrote:
> On Tue, Mar 19, 2024 at 02:33:35PM +0200, Heikki Linnakangas wrote:
> > On 18/03/2024 17:19, Melanie Plageman wrote:
> > > I've attached v7 rebased over this commit.
> >
> > If we delayed table_beginscan_bm() call further, after starting the TBM
> > iterator, we could skip it altogether when the iterator is empty.
> >
> > That's a further improvement, doesn't need to be part of this patch set.
> > Just caught my eye while reading this.
>
> Hmm. You mean like until after the first call to tbm_[shared]_iterate()?
> AFAICT, tbm_begin_iterate() doesn't tell us anything about whether or
> not the iterator is "empty". Do you mean cases when the bitmap has no
> blocks in it? It seems like we should be able to tell that from the
> TIDBitmap.
>
> >
> > > v7-0003-Push-BitmapHeapScan-skip-fetch-optimization-into-.patch
> >
> > I suggest to avoid the double negative with SO_CAN_SKIP_FETCH, and call the
> > flag e.g. SO_NEED_TUPLE.
>
> Agreed. Done in attached v8. Though I wondered if it was a bit weird
> that the flag is set in the common case and not set in the uncommon
> case...

v8 actually attached this time

Attachment Content-Type Size
v8-0001-BitmapHeapScan-begin-scan-after-bitmap-creation.patch text/x-diff 2.8 KB
v8-0002-BitmapHeapScan-set-can_skip_fetch-later.patch text/x-diff 2.2 KB
v8-0003-Push-BitmapHeapScan-skip-fetch-optimization-into-.patch text/x-diff 15.0 KB
v8-0004-BitmapPrefetch-use-prefetch-block-recheck-for-ski.patch text/x-diff 2.2 KB
v8-0005-Update-BitmapAdjustPrefetchIterator-parameter-typ.patch text/x-diff 2.3 KB
v8-0006-table_scan_bitmap_next_block-returns-lossy-or-exa.patch text/x-diff 4.4 KB
v8-0007-Reduce-scope-of-BitmapHeapScan-tbmiterator-local-.patch text/x-diff 2.9 KB
v8-0008-Remove-table_scan_bitmap_next_tuple-parameter-tbm.patch text/x-diff 4.1 KB
v8-0009-Make-table_scan_bitmap_next_block-async-friendly.patch text/x-diff 22.9 KB
v8-0010-Hard-code-TBMIterateResult-offsets-array-size.patch text/x-diff 5.4 KB
v8-0011-table_scan_bitmap_next_block-counts-lossy-and-exa.patch text/x-diff 5.2 KB
v8-0012-Separate-TBM-Shared-Iterator-and-TBMIterateResult.patch text/x-diff 19.7 KB
v8-0013-Push-BitmapHeapScan-prefetch-code-into-heapam.c.patch text/x-diff 33.7 KB
v8-0014-Unify-parallel-and-serial-BitmapHeapScan-iterator.patch text/x-diff 11.3 KB
v8-0015-Remove-table_scan_bitmap_next_block.patch text/x-diff 11.2 KB
v8-0016-v7-Streaming-Read-API.patch text/x-diff 56.1 KB
v8-0017-BitmapHeapScan-uses-streaming-read-API.patch text/x-diff 26.5 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Thomas Munro 2024-03-23 00:45:28 Re: Cannot find a working 64-bit integer type on Illumos
Previous Message Thomas Munro 2024-03-23 00:25:38 Re: pg_upgrade --copy-file-range