Re: speeding up grafana sensor-data query on raspberry pi 3

From: David Rowley <dgrowleyml(at)gmail(dot)com>
To: Clemens Eisserer <linuxhippy(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: speeding up grafana sensor-data query on raspberry pi 3
Date: 2023-04-16 20:50:31
Message-ID: CAApHDvo4caWt8vUWWZebf0e8Z7HO_2A4W_EyKJLQgms2da6c+A@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Mon, 17 Apr 2023 at 05:00, Clemens Eisserer <linuxhippy(at)gmail(dot)com> wrote:
> Example:
> table smartmeter with non-null column ts (timestamp with time zone)
> and brinc index on ts, no pk to avoid a btree index.
> Sensor values are stored every 5s, so for 1 month there are about 370k
> rows - and in total the table currently holds about 3M rows.
> The query to display the values for 1 month takes ~3s, with the bitmap
> heap scan as well as aggregation taking up most of the time, with
> sorting in between.

I know you likely don't have much RAM to spare here, but more work_mem
might help, even just 16MBs might be enough. This would help the Sort
and to a lesser extent the Bitmap Heap Scan too.

Also, if you'd opted to use PostgreSQL 14 or 15, then you could have
performed CREATE STATISTICS on your GROUP BY clause expression and
then run ANALYZE. That might cause the planner to flip to a Hash
Aggregate which would eliminate the Sort before aggregation. You'd
only need to sort 236 rows after the Hash Aggregate for the ORDER BY.

Plus, what Justin said.

David

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Andres Freund 2023-04-16 22:10:17 Re: speeding up grafana sensor-data query on raspberry pi 3
Previous Message Justin Pryzby 2023-04-16 17:15:11 Re: speeding up grafana sensor-data query on raspberry pi 3