Re: My DB has has 5TB, many operations are very slow (on Google Cloud Compute)

From: Francisco Olarte <folarte(at)peoplecall(dot)com>
To: David A <david(at)scalaacademy(dot)com>
Cc: "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: My DB has has 5TB, many operations are very slow (on Google Cloud Compute)
Date: 2016-10-11 18:17:50
Message-ID: CA+bJJbw=cgQr-4fSCAqF35ctBswftKiXqmKMM4O1N603T5X42g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Thu, Oct 6, 2016 at 12:36 AM, David A <david(at)scalaacademy(dot)com> wrote:
> My DB has has 5TB, it's on Google Cloud Compute, mostly on SSDs, part on
> Standard Persistent Disks.
> Querying is ok, but deleting, moving between tablespaces, dropping tables,
> etc, etc is hugely slow
> (note: I do have a number of indexes)

Are you sure it's slow and not just lengthy? Hostings tend to have and
publish limits on their bandwidths and similar things, and may be you
are just saturating your capacity. If you can at least compare the
time to move a tablespace against the time of copying a similarly
sized file between the same disks someone may be able to say
something.

> Instance RAM: 60GB
> Instance CPU: 16Cores

Cores do not help, postgres is single-threaded. RAM MAY help, but I
suspect your operations are IO bound. Of course, with the sparseness
of the details, one can not say too much.

Francisco Olarte.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Scott Mead 2016-10-11 18:21:48 Re: Postgresql using lxd faild to find address
Previous Message Rémi Cura 2016-10-11 17:41:28 Re: forcing a table (parent in inheritance) tor emain empty