Re: [Proposal] Add accumulated statistics

From: Adrien NAYRAT <adrien(dot)nayrat(at)anayrat(dot)info>
To: "Tsunakawa, Takayuki" <tsunakawa(dot)takay(at)jp(dot)fujitsu(dot)com>, "Yotsunaga, Naoki" <yotsunaga(dot)naoki(at)jp(dot)fujitsu(dot)com>, 'Bruce Momjian' <bruce(at)momjian(dot)us>, "'Phil Florent'" <philflorent(at)hotmail(dot)com>, 'Michael Paquier' <michael(at)paquier(dot)xyz>, 'Tomas Vondra' <tomas(dot)vondra(at)2ndquadrant(dot)com>
Cc: "pgsql-hackers(at)lists(dot)postgresql(dot)org" <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: [Proposal] Add accumulated statistics
Date: 2019-01-07 13:43:07
Message-ID: ebb2f596-304c-dc70-7eaa-a58aef39016c@anayrat.info
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 1/7/19 6:34 AM, Tsunakawa, Takayuki wrote:
> 1. Doesn't provide precise data
> Sampling could miss intermittent short waits, e.g., buffer content lock waits during checkpoints. This might make it difficult or impossible to solve transient performance problems, such as infrequent 100 millisecond response times while the normal response time is a few milliseconds.
> The proposed wait event collection doesn't miss anything.
>
> 2. Overuses resources
> We may be able to shorten the sampling interval to 10 ms or even 1 ms to detect short periods of problems. However, the sampled data of active sessions become voluminous in memory and storage. It would take longer to analyze those samples. Also, the background sampling process prevents the CPU core from becoming idle to save power, which bgwriter and walwriter tries to avoid by hibernation.
> The proposed wait event collection just records what actually happened. No waste. Would it use many resources if waits happen frequently? That leads to our motivation to reduce waits.

FIY, wait events have been added in PoWA by using pg_wait_sampling
extension :
https://rjuju.github.io/postgresql/2018/07/09/wait-events-support-for-powa.html

pg_wait_sampling sample the wait events in shared memory and PoWA store
them.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Jesper Pedersen 2019-01-07 13:48:38 Re: pg_upgrade: Pass -j down to vacuumdb
Previous Message Peter Eisentraut 2019-01-07 12:59:58 Re: START/END line number for COPY FROM