Re: Using AWS ephemeral SSD storage for production database workload?

From: Ben Madin <ben(at)ausvet(dot)com(dot)au>
To: Pritam Barhate <pritambarhate(at)gmail(dot)com>
Cc: Paul A Jungwirth <pj(at)illuminatedcomputing(dot)com>, Steven Lembark <lembark(at)wrkhors(dot)com>, pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: Using AWS ephemeral SSD storage for production database workload?
Date: 2018-01-30 03:02:46
Message-ID: CA+weYr1GaTRu7_a+PmUZdMvwuRc5p=qa2cMLPifei6-aBj8WZw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

G'day all,

We have been doing this in production for about five years, the client is
aware of the trade off between speed, cost and availability. (By this I
mean, if it goes down for a few minutes, no big concern to them). We had
around 2 million users, but very small payloads.

We take full database backups every six hours, log-ship to s3, and run
multiple hot streaming servers for a high level of user query activity.

Obviously, the risk was always there of an un-planned shutdown, but we had
very good performance on a very cheap setup. m3.medium / ubuntu anyone!

Disclaimer - we don't do this any more for our bigger production systems
... for a number of reasons. We ran out of space on the SSD, our write
queries are generally small and not complex, so we went to EBS backed
without PIOPS, and haven't really noticed any major problems with
performance. I felt that the risk / humbug associated with needing to
upgrade the operating system etc made it easier to just use the EBS. This
does also mean we can vertically scale our DB server easily and securely.
We still have hot-streaming replications, back ups and log shipping.

hth

cheers

Ben

On 30 January 2018 at 04:36, Pritam Barhate <pritambarhate(at)gmail(dot)com> wrote:

> Thank you, Paul and Steven, for the information.
>
> @Paul: Thanks for the link. Planning to read through most of fdr's
> comments on Hacker News.
>
> @Steven:
>
> > Q: Why not just use RDS?
>
> > It'll be simpler.
>
> Already using it for multiple deployments. I am primarily a programmer.
> But now want to get out of the RDS convenience zone.
>
> Regards,
>
> Pritam.
>
>

--

Dr Ben Madin
Managing Director

m : +61 448 887 220

e : ben(at)ausvet(dot)com(dot)au

5 Shuffrey Street, Fremantle
Western Australia

on the web: www.ausvet.com.au

This transmission is for the intended addressee only and is confidential
information. If you have received this transmission in error, please delete
it and notify the sender. The contents of this email are the opinion of the
writer only and are not endorsed by Ausvet unless expressly stated
otherwise. Although Ausvet uses virus scanning software we do not accept
liability for viruses or similar in any attachments.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Sam Gendler 2018-01-30 03:05:39 Re: Using AWS ephemeral SSD storage for production database workload?
Previous Message David G. Johnston 2018-01-30 02:07:59 Re: Information on savepoint requirement within transctions