Re: Read data from Postgres table pages

From: Sushrut Shivaswamy <sushrut(dot)shivaswamy(at)gmail(dot)com>
To: Alexander Korotkov <aekorotkov(at)gmail(dot)com>
Cc: pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: Read data from Postgres table pages
Date: 2024-03-19 14:33:35
Message-ID: CAH5mb988a-fDKte7OVhfb1iWfT2+on6pSfmi7yZoODEvwFAn5g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

I'd like to read individual rows from the pages as they are updated and
stream them to a server to create a copy of the data.
The data will be rewritten to columnar format for analytics queries.

On Tue, Mar 19, 2024 at 7:58 PM Alexander Korotkov <aekorotkov(at)gmail(dot)com>
wrote:

> Hi
>
> On Tue, Mar 19, 2024 at 4:23 PM Sushrut Shivaswamy
> <sushrut(dot)shivaswamy(at)gmail(dot)com> wrote:
> > I'm trying to build a postgres export tool that reads data from table
> pages and exports it to an S3 bucket. I'd like to avoid manual commands
> like pg_dump, I need access to the raw data.
> >
> > Can you please point me to the postgres source header / cc files that
> encapsulate this functionality?
> > - List all pages for a table
> > - Read a given page for a table
> >
> > Any pointers to the relevant source code would be appreciated.
>
> Why do you need to work on the source code level?
> Please, check this about having a binary copy of the database on the
> filesystem level.
> https://www.postgresql.org/docs/current/backup-file.html
>
> ------
> Regards,
> Alexander Korotkov
>

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Sushrut Shivaswamy 2024-03-19 14:35:03 Re: Read data from Postgres table pages
Previous Message stephane tachoires 2024-03-19 14:29:47 Re: Add SPLIT PARTITION/MERGE PARTITIONS commands