From: | Melanie Plageman <melanieplageman(at)gmail(dot)com> |
---|---|
To: | Pg Hackers <pgsql-hackers(at)postgresql(dot)org> |
Cc: | David Rowley <dgrowleyml(at)gmail(dot)com>, Andres Freund <andres(at)anarazel(dot)de>, Thomas Munro <thomas(dot)munro(at)gmail(dot)com>, Heikki Linnakangas <hlinnaka(at)iki(dot)fi> |
Subject: | Re: Streaming read-ready sequential scan code |
Date: | 2024-02-26 20:56:57 |
Message-ID: | CAAKRu_bhaY7rxhfhCDo0D0wPaM24ugT1yPtiJ92sceTegNB4ww@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
On Mon, Feb 19, 2024 at 6:05 PM Melanie Plageman
<melanieplageman(at)gmail(dot)com> wrote:
>
> On Mon, Jan 29, 2024 at 4:17 PM Melanie Plageman
> <melanieplageman(at)gmail(dot)com> wrote:
> >
> > There is an outstanding question about where to allocate the
> > PgStreamingRead object for sequential scans
>
> I've written three alternative implementations of the actual streaming
> read user for sequential scan which handle the question of where to
> allocate the streaming read object and how to handle changing scan
> direction in different ways.
>
> Option A) https://github.com/melanieplageman/postgres/tree/seqscan_pgsr_initscan_allocation
> - Allocates the streaming read object in initscan(). Since we do not
> know the scan direction at this time, if the scan ends up not being a
> forwards scan, the streaming read object must later be freed -- so
> this will sometimes allocate a streaming read object it never uses.
> - Only supports ForwardScanDirection and once the scan direction
> changes, streaming is never supported again -- even if we return to
> ForwardScanDirection
> - Must maintain a "fallback" codepath that does not use the streaming read API
Attached is a version of this patch which implements a "reset"
function for the streaming read API which should be cheaper than the
full pg_streaming_read_free() on rescan. This can easily be ported to
work on any of my proposed implementations (A/B/C). I implemented it
on A as an example.
- Melanie
Attachment | Content-Type | Size |
---|---|---|
v2-0002-Replace-blocks-with-buffers-in-heapgettup-control.patch | text/x-patch | 7.8 KB |
v2-0004-Add-pg_streaming_read_reset.patch | text/x-patch | 1.9 KB |
v2-0001-Split-heapgetpage-into-two-parts.patch | text/x-patch | 7.9 KB |
v2-0005-Sequential-scans-support-streaming-read.patch | text/x-patch | 7.3 KB |
v2-0003-Streaming-Read-API.patch | text/x-patch | 56.0 KB |
From | Date | Subject | |
---|---|---|---|
Next Message | Andrew Atkinson | 2024-02-26 21:13:34 | Re: Add publisher and subscriber to glossary documentation. |
Previous Message | stepan rutz | 2024-02-26 20:54:11 | Re: Detoasting optionally to make Explain-Analyze less misleading |