From: | Vijaykumar Jain <vijaykumarjain(dot)github(at)gmail(dot)com> |
---|---|
To: | Pól Ua Laoínecháin <linehanp(at)tcd(dot)ie> |
Cc: | PostgreSQL General <pgsql-general(at)lists(dot)postgresql(dot)org> |
Subject: | Re: Partitioning a table by integer value (preferably in place) |
Date: | 2021-08-09 16:01:11 |
Message-ID: | CAM+6J949imQdsS2ZiXjBQtYYng_1fqODogjnQ5vovp6O8thCCw@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
>
>
>
> I have a 400GB joining table (one SMALLINT and the other INTEGER -
> Primary Keys on other tables) with 1000 fields on one side and 10M on
> the other, so 10,000M (or 10Bn) records all told.
>
My queries:
>
> Do you have any explain analyze,buffers
<query> results with the existing setup? Does it look problematic?
How would your table grow on either side of the join ? Append only, static
data or too frequently updated etc, or dropped periodically, so that delete
based bloating can be skipped completely.
How distributed is the data based on smallint keys, equally or unequally.
What kind of queries would be run and results returned ? Oltp or olap like
? Quick queries with few rows retuned or heavy queries with lot of rows
returned.
Partitioning has been ever improving, so the best option if possible would
be to use the latest pg version is possible,.
Also is there any scope of normalisation of that table, I mean I know
theoretically it is possible, but I have not seen any design with that wide
table( of 1000 cols), so would be good to know.
Just asking, maybe partitioning would the best option but wanting to
know/see the benefit pre and post partitioning.
>
>
--
Thanks,
Vijay
Mumbai, India
From | Date | Subject | |
---|---|---|---|
Next Message | Mladen Gogala | 2021-08-09 16:23:40 | Re: JWT decoder |
Previous Message | Ron | 2021-08-09 14:54:07 | Re: Partitioning a table by integer value (preferably in place) |