Re: Backup PostgreSQL from RDS straight to S3

On 9/18/19 12:04 PM, Anthony DeBarros wrote:
> Great, thanks. The question I have, which at first glance isn't covered
> there, is whether those instructions will at any point bring the dump
> file onto the EC2 box, either in memory or temp file storage, on its way
> to S3? I don't know enough about how Linux handles data piped from one
> command to the next to know whether that's standard OP or not.

Good intoduction:

https://ryanstutorials.net/linuxtutorial/piping.php

The piping section is down the page

Basically | connects the output of one command directly to input of
another. Run a test case in one terminal and top in another to see the
effect om memory.

>
> On Wed, Sep 18, 2019 at 2:36 PM Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com
> <mailto:adrian(dot)klaver(at)aklaver(dot)com>> wrote:
>
> On 9/18/19 11:32 AM, Anthony DeBarros wrote:
> > Hi, folks -- I'm a longtime PostgreSQL user but a bit of a noob
> when it
> > comes to maintenance. Question:
> >
> > I'm running PostgreSQL 11 on Amazon RDS. Also have an EC2 box
> running
> > Ubuntu that runs some Python scripts that collect data into
> PostgreSQL.
> >
> > We're doing the standard RDS backups. However, I'd also like to do a
> > nightly pg_dump and store that file on S3. Is there a way to go
> straight
> > from RDS to S3 without having to download the dump file onto the
> EC2 box
> > at any point? I want to avoid a scenario where the DB file fills
> the EC2
> > box's disk.
>
> ?:
> https://dba.stackexchange.com/questions/221454/best-way-to-pg-dump-postgresql-on-rds-to-s3
>
> >
> > Thanks for any and all advice!
> >
> > Anthony
> >
> >
>
>
> --
> Adrian Klaver
> adrian(dot)klaver(at)aklaver(dot)com <mailto:adrian(dot)klaver(at)aklaver(dot)com>
>

--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com