Re: Implement UNLOGGED clause for COPY FROM

From: Kyotaro Horiguchi <horikyota(dot)ntt(at)gmail(dot)com>
To: tsunakawa(dot)takay(at)fujitsu(dot)com
Cc: smithpb2250(at)gmail(dot)com, amit(dot)kapila16(at)gmail(dot)com, masahiko(dot)sawada(at)2ndquadrant(dot)com, osumi(dot)takamichi(at)fujitsu(dot)com, tgl(at)sss(dot)pgh(dot)pa(dot)us, david(dot)g(dot)johnston(at)gmail(dot)com, pgsql-hackers(at)postgresql(dot)org
Subject: Re: Implement UNLOGGED clause for COPY FROM
Date: 2020-09-11 08:36:19
Message-ID: 20200911.173619.228723076079394400.horikyota.ntt@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

At Fri, 11 Sep 2020 05:15:32 +0000, "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> wrote in
> From: Peter Smith <smithpb2250(at)gmail(dot)com>
> On Thu, Sep 10, 2020 at 7:16 PM tsunakawa(dot)takay(at)fujitsu(dot)com
> > <tsunakawa(dot)takay(at)fujitsu(dot)com> wrote:
> > > ALTER TABLE takes long time proportional to the amount of existing data,
> > while wal_level = none doesn't.
> >
> > Right, but if wal_level=none is considered OK for that table with
> > existing data, then why not just create the table UNLOGGED in the
> > first place? (or ALTER it to set UNLOGGED just one time and then leave
> > it as UNLOGGED).
>
> The target tables sometimes receive updates (for data maintenance and/or correction). They don't want those updates to be lost due to the database server crash. Unlogged tables lose their entire contents during crash recovery.
>
> Please think like this: logging is is the norm, and unlogged operations are exceptions/hacks for some requirement of which the user wants to minimize the use.

I suspect that wal_level=none is a bit too toxic.

"ALTER TABLE SET UNLOGGED" doesn't dump large amount of WAL so I don't
think it can be a problem. "ALTER TABLE SET LOGGED" also doesn't issue
WAL while wal_level=minimal but runs a table copy. I think the only
problem of the UNLOGGED table method is that table copy.

If we can skip the table-copy when ALTER TABLE SET LOGGED on
wal_level=minimal, is your objective achived?

regards.

--
Kyotaro Horiguchi
NTT Open Source Software Center

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message laurent.feron 2020-09-11 08:41:15 TDE (Transparent Data Encryption) supported ?
Previous Message tsunakawa.takay@fujitsu.com 2020-09-11 08:15:08 RE: Transactions involving multiple postgres foreign servers, take 2