Amount of unused space on a storage device

From: Michal Merta <michal(dot)merta(at)greycortex(dot)com>
To: pgsql-admin <pgsql-admin(at)postgresql(dot)org>
Subject: Amount of unused space on a storage device
Date: 2017-08-31 14:52:05
Message-ID: 37bd3391-30db-292c-0cf9-110860461b0d@greycortex.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Hello everyone,

We have an OLAP database on dedicated RAID storage with a total capacity
of 100TB. The transaction log and temp_tablespace are stored on a
separated drive.
All tables are partitioned by timestamp of insert, the size of each
partition is 1 week. All tables are insert only, no update or delete
ever occurs. The amount of data stored peer week is ~1TB.

We use following maintenance algorithm:
IF amount of free space on storage is lower than BOUNDARY, THEN
backup all partitions for oldest week
drop these partitions from database

Our desired behavior is to keep as much data as possible in database for
analytical queries.

My question is:
Having 100TB capacity and data coming in at a fixed rate of ~1TB per
week, what would be an optimal BOUNDARY? Or to put it another way, what
is a reasonable amount of unused space on a storage device of this size?

Thanks & Regards,
Michal Merta

Browse pgsql-admin by date

  From Date Subject
Next Message Raj Gandhi 2017-09-01 02:27:31 custom cast for to_json()
Previous Message Roman Konoval 2017-08-31 12:26:34 Re: printing results of query to file in different times