Re: Add new error_action COPY ON_ERROR "log"

From: Bharath Rupireddy <bharath(dot)rupireddyforpostgres(at)gmail(dot)com>
To: Michael Paquier <michael(at)paquier(dot)xyz>
Cc: torikoshia <torikoshia(at)oss(dot)nttdata(dot)com>, "David G(dot) Johnston" <david(dot)g(dot)johnston(at)gmail(dot)com>, jian(dot)universality(at)gmail(dot)com, Pgsql Hackers <pgsql-hackers(at)postgresql(dot)org>, Alexander Korotkov <aekorotkov(at)gmail(dot)com>
Subject: Re: Add new error_action COPY ON_ERROR "log"
Date: 2024-03-11 12:30:00
Message-ID: CALj2ACUZkGMTz10kC3+LcxjGz6NMN1URTn8+K=k_rtm7=z8zSA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Mon, Mar 11, 2024 at 11:16 AM Michael Paquier <michael(at)paquier(dot)xyz> wrote:
>
> At the end of the day, this comes down to what is more helpful to the
> user. And I'd agree on the side what ON_ERROR does currently, which
> is what your patch relies on: on the first conversion failure, give up
> and skip the rest of the row because we cannot trust its contents.
> That's my way of saying that I am fine with the proposal of your
> patch, and that we cannot provide the full state of a row without
> making the error stack of COPY more invasive.

+1.

> + <literal>verbose</literal>, a <literal>NOTICE</literal> message
> + containing the line number and column name for each discarded row is
> + emitted.
>
> This should clarify that the column name refers to the attribute where
> the input conversion has failed, I guess. Specifying only "column
> name" without more context is a bit confusing.

Done.

Please see the attached v6 patch set.

--
Bharath Rupireddy
PostgreSQL Contributors Team
RDS Open Source Databases
Amazon Web Services: https://aws.amazon.com

Attachment Content-Type Size
v6-0001-Add-LOG_VERBOSITY-option-to-COPY-command.patch application/octet-stream 9.5 KB
v6-0002-Add-detailed-info-when-COPY-skips-soft-errors.patch application/octet-stream 4.9 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Zhijie Hou (Fujitsu) 2024-03-11 12:34:08 RE: Test failures of 100_bugs.pl
Previous Message Aleksander Alekseev 2024-03-11 12:24:57 Re: type cache cleanup improvements