how to make duplicate finding query faster?

From: Sachin Kumar <sachinkumaras(at)gmail(dot)com>
To: pgsql-admin(at)postgresql(dot)org, krishna(at)thewebconz(dot)com, pgsql-admin(at)lists(dot)postgresql(dot)org
Subject: how to make duplicate finding query faster?
Date: 2020-12-30 07:36:40
Message-ID: CALg-PKBPQPBMbNAxf-pF0OLbYs0exC7Vf2Sn3hNPUAJ7Q=mPtA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Hi All,

I am uploading data into PostgreSQL using the CSV file and checking if
there is any duplicates value in DB it should return a duplicate error. I
am using below mention query.

if Card_Bank.objects.filter( Q(ACCOUNT_NUMBER=card_number) ).exists():
flag=2
else:
flag=1
it is taking too much time i am using 600k cards in CSV.

Kindly help me in making the query faster.

I am using Python, Django & PostgreSQL.
--

Best Regards,
Sachin Kumar

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Holger Jakobs 2020-12-30 08:23:42 Re: how to make duplicate finding query faster?
Previous Message Tom Lane 2020-12-29 23:16:27 Re: Patroni issue