Re: 2 million queries against a table

From: Rob Sargent <robjsargent(at)gmail(dot)com>
To: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: 2 million queries against a table
Date: 2020-07-15 15:55:59
Message-ID: a13db24b-dd45-b1e5-c2de-2bc8edb810ae@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 7/15/20 9:38 AM, Tom Lane wrote:
> Adam Sanchez <a(dot)sanchez75(at)gmail(dot)com> writes:
>> I need to run 2 million queries against a three columns table t
>> (s,p,o) which size is 10 billions rows. The data type of each column
>> is string. The server has 512G RAM, 32 cores and 14T SSD (RAID 0)
>
>> Only two types of queries:
>
>> select s p o from t where s = param
>> select s p o from t where o = param
>
> TBH, this is a pretty silly way to use a SQL database. Put
> the probe values into a temporary table (in batches, perhaps)
> and do a join. The per-row cost of that sort of approach
> will be multiple orders of magnitude smaller than a query
> per row.
>
> regards, tom lane
>
>
I had assumed the OP was planning a performance test for say 2M separate
user/requests (perhaps non-unique) rather than asking for the specific
2M records.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Naresh Kumar 2020-07-15 16:33:06 Re: psql: FATAL: database "postgres" does not exist or ERROR: 23505: duplicate key value violates unique constraint "pg_namespace_nspname_index"
Previous Message Laurent FAILLIE 2020-07-15 15:54:03 Re: Clustering solution ?