Re: get counts of multiple field values in a jsonb column

From: Simon Riggs <simon(at)2ndquadrant(dot)com>
To: Martin Norbäck Olivers <martin(at)norpan(dot)org>
Cc: pgsql-sql(at)lists(dot)postgresql(dot)org
Subject: Re: get counts of multiple field values in a jsonb column
Date: 2020-10-20 08:56:42
Message-ID: CANP8+jLr3drBfor0dM-8QrN+0KgCgw+zzJwCFvZyHE9HrPWfrg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

On Sat, 17 Oct 2020 at 16:00, Martin Norbäck Olivers <martin(at)norpan(dot)org> wrote:
>
> HI!
> I'm using postgres to store unstructured fields in a jsonb column. I also have a quite complicated query on the table, joining it with other tables etc, and given that query I want to get a count of all the values for a number of keys in the data.
>
> Currently I'm doing one query for each key, like this
> select data->>'field1', count(*) from COMPLICATED QUERY group by 1
> select data->>'field2', count(*) from COMPLICATED QUERY group by 1
> ...
> select data->>'fieldN', count(*) from COMPLICATED QUERY group by 1
>
> field1, field2, ..., fieldN are known at query time.
>
> But as the number of keys I want to count for increases, so does the time it takes to run all these queries. I think the main problem is that COMPLICATED QUERY is complicated and takes time to run each time. I would very much like to run only one query that counts all the values of all the fields, but I'm not quite sure how to do that. I'm looking at all the aggregation functions but can't quite find one that suits this purpose.
>
> I would love to get some input on ways to make this faster.

You want something like this...

select key, count(*) from (select (jsonb_each_text(data)).key from
COMPLICATED QUERY) as kv group by 1;

--
Simon Riggs http://www.EnterpriseDB.com/

In response to

Browse pgsql-sql by date

  From Date Subject
Next Message Andreas Joseph Krogh 2020-10-21 20:27:29 Best way to change values of a primary key referenced by many tables
Previous Message Rob Sargent 2020-10-17 16:15:12 Re: get counts of multiple field values in a jsonb column