From: | Sushrut Shivaswamy <sushrut(dot)shivaswamy(at)gmail(dot)com> |
---|---|
To: | Alexander Korotkov <aekorotkov(at)gmail(dot)com> |
Cc: | pgsql-hackers(at)lists(dot)postgresql(dot)org |
Subject: | Re: Read data from Postgres table pages |
Date: | 2024-03-19 14:33:35 |
Message-ID: | CAH5mb988a-fDKte7OVhfb1iWfT2+on6pSfmi7yZoODEvwFAn5g@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
I'd like to read individual rows from the pages as they are updated and
stream them to a server to create a copy of the data.
The data will be rewritten to columnar format for analytics queries.
On Tue, Mar 19, 2024 at 7:58 PM Alexander Korotkov <aekorotkov(at)gmail(dot)com>
wrote:
> Hi
>
> On Tue, Mar 19, 2024 at 4:23 PM Sushrut Shivaswamy
> <sushrut(dot)shivaswamy(at)gmail(dot)com> wrote:
> > I'm trying to build a postgres export tool that reads data from table
> pages and exports it to an S3 bucket. I'd like to avoid manual commands
> like pg_dump, I need access to the raw data.
> >
> > Can you please point me to the postgres source header / cc files that
> encapsulate this functionality?
> > - List all pages for a table
> > - Read a given page for a table
> >
> > Any pointers to the relevant source code would be appreciated.
>
> Why do you need to work on the source code level?
> Please, check this about having a binary copy of the database on the
> filesystem level.
> https://www.postgresql.org/docs/current/backup-file.html
>
> ------
> Regards,
> Alexander Korotkov
>
From | Date | Subject | |
---|---|---|---|
Next Message | Sushrut Shivaswamy | 2024-03-19 14:35:03 | Re: Read data from Postgres table pages |
Previous Message | stephane tachoires | 2024-03-19 14:29:47 | Re: Add SPLIT PARTITION/MERGE PARTITIONS commands |