Re: [ADMIN] pg_class reltuples/relpages not updated by autovacuum/vacuum

From: Greg Stark <gsstark(at)mit(dot)edu>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, Florian Helmberger <fh(at)25th-floor(dot)com>, pgsql-hackers(at)postgresql(dot)org, Alvaro Herrera <alvherre(at)commandprompt(dot)com>
Subject: Re: [ADMIN] pg_class reltuples/relpages not updated by autovacuum/vacuum
Date: 2011-05-26 05:05:53
Message-ID: BANLkTi=jcKSU5zR+JG2BvfLNCtezC9sb+g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin pgsql-hackers

On Wed, May 25, 2011 at 9:41 AM, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:
> Yeah, I had been thinking about the latter point.  We could be
> conservative and just keep the reported tuple density the same (ie,
> update relpages to the new correct value, while setting reltuples so
> that the density ratio doesn't change).  But that has its own problems
> when the table contents *do* change.  What I'm currently imagining is
> to do a smoothed moving average, where we factor in the new density
> estimate with a weight dependent on the percentage of the table we did
> scan.  That is, the calculation goes something like
>
> old_density = old_reltuples / old_relpages
> new_density = counted_tuples / scanned_pages
> reliability = scanned_pages / new_relpages
> updated_density = old_density + (new_density - old_density) * reliability
> new_reltuples = updated_density * new_relpages

This amounts to assuming that the pages observed in the vacuum have
the density observed and the pages that weren't seen have the density
that were previously in the reltuples/relpages stats. That seems like
a pretty solid approach to me. If the numbers were sane before it
follows that they should be sane after the update.

--
greg

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Greg Stark 2011-05-26 05:12:13 Re: [ADMIN] pg_class reltuples/relpages not updated by autovacuum/vacuum
Previous Message Fujii Masao 2011-05-26 01:42:08 Re: Seems like a large amount of xlog files

Browse pgsql-hackers by date

  From Date Subject
Next Message Greg Stark 2011-05-26 05:12:13 Re: [ADMIN] pg_class reltuples/relpages not updated by autovacuum/vacuum
Previous Message Fujii Masao 2011-05-26 04:38:15 Re: tackling full page writes