From: | Bruce Momjian <bruce(at)momjian(dot)us> |
---|---|
To: | James Healy <james(at)yob(dot)id(dot)au> |
Cc: | pgsql-general(at)lists(dot)postgresql(dot)org |
Subject: | Re: Gradual migration from integer to bigint? |
Date: | 2023-09-30 17:35:02 |
Message-ID: | ZRhcRnnUrGsB3p7K@momjian.us |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
On Sat, Sep 30, 2023 at 03:55:20PM +1000, James Healy wrote:
> My organization has a number of very large tables (most 100s of GB, a
> couple over a Tb) that were created many years ago by a tool that
> defaulted to integer PKs rather than bigint. Those PKs have a number
> of integer FKs in related tables as well. We shouldn't have let them
> get so big, but that's a conversation for another day.
>
> Some are approaching overflow and we're slowly doing the work to
> migrate to bigint. Mostly via the well understood "add a new id_bigint
> column, populate on new tuples, backfill the old, switch the PK"
> method. The backfill is slow on these large tables, but it works and
> there's plenty of blog posts and documentation to follow.
>
> It did make me curious though: would it be possible for postgres to
> support gradual migration from integer to bigint in a more transparent
> way, where new and updated tuples are written as bigint, but existing
> tuples can be read as integer?
>
> I assume maybe a complication is that the catalog says the column is
> either 32bit int or 64bit bigint and making that conditional is hard.
> There's presumably other considerations I'm unaware of too. My core
> question: are there significant technical blockers to supporting this
> kind of gradual in place migration, or has it just not been enough of
> a problem that it's received attention?
I think this talk will help you:
https://www.youtube.com/watch?v=XYRgTazYuZ4
--
Bruce Momjian <bruce(at)momjian(dot)us> https://momjian.us
EDB https://enterprisedb.com
Only you can decide what is important to you.
From | Date | Subject | |
---|---|---|---|
Next Message | pf | 2023-09-30 18:32:55 | Re: cache lookup failed for function 0 |
Previous Message | Tom Lane | 2023-09-30 17:20:14 | Re: cache lookup failed for function 0 |