Finding Duplicate Rows during INSERTs

From: Rich Shepard <rshepard(at)appl-ecosys(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Finding Duplicate Rows during INSERTs
Date: 2012-07-09 22:48:47
Message-ID: alpine.LNX.2.00.1207091545100.17482@salmo.appl-ecosys.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Source data has duplicates. I have a file that creates the table then
INSERTS INTO the table all the rows. When I see errors flash by during the
'psql -d <database> -f <file.sql>' I try to scroll back in the terminal to
see where the duplicate rows are located. Too often they are too far back to
let me scroll to see them.

There must be a better way of doing this. Can I run psql with the tee
command to capture errors in a file I can examine? What is the proper/most
efficient way to identify the duplicates so they can be removed?

TIA,

Rich

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Rob Sargent 2012-07-10 00:01:06 Re: Finding Duplicate Rows during INSERTs
Previous Message Willy-Bas Loos 2012-07-09 22:04:33 Re: Tutorial On Connecting LibreOffice to PostgreSQL Available