Creating A GIN index on JSONB column (large database)

From: Taylor Smith <taylorjrsmith(at)gmail(dot)com>
To: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Creating A GIN index on JSONB column (large database)
Date: 2022-08-09 14:04:35
Message-ID: CAPLtOc=Psv+jm73YQDW-x0jj2qhvFBDVh0nK0MoSB=hRKAxL=Q@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi all,

I have a database that is in excess of 20TB in size, partitioned by date on
a month to month basis.

There is a column within that stores text (validated to be json but not
stored as JSONB). I have a requirement to make the json searchable using
GIN indexes. however when we try to create the GIN index on AWS RDS our
temp storage maxes out which crashes the create process resulting in
unhealthy created indexes.

This might be an AWS issue but we are wondering the reason why creating
these indexes (concurrently) would cause the temp storage to blow up and
crash out and is it possible to mitigate or a necessary evil.

The only solution we have so far is scale up our RDS instance.

Kind regards,

Taylor Smith

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Rob Sargent 2022-08-09 14:39:40 Re: Creating A GIN index on JSONB column (large database)
Previous Message Fabrice Chapuis 2022-08-09 06:39:17 Re: pg_restore remap schema