Re: Finding Duplicate Rows during INSERTs

From: Rich Shepard <rshepard(at)appl-ecosys(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: Finding Duplicate Rows during INSERTs
Date: 2012-07-10 01:03:15
Message-ID: alpine.LNX.2.00.1207091801370.17482@salmo.appl-ecosys.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Mon, 9 Jul 2012, Rob Sargent wrote:

> psql -d <database> -f file.sql > file.log 2>&1 would give you a logfile

Rob,

Ah, yes. I forgot about redirecting stdout to a file.

> sort -u file.raw > file.uniq might give you clean data?

Not when it has the SQL on each line. I thought that I had eliminated
duplicates in the raw file, but with 128K rows I obviously missed many.

Thanks,

Rich

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Darren Duncan 2012-07-10 02:54:23 Re: Finding Duplicate Rows during INSERTs
Previous Message Don Parris 2012-07-10 00:20:15 Re: Tutorial On Connecting LibreOffice to PostgreSQL Available