Re: add recovery, backup, archive, streaming etc. activity messages to server logs along with ps display

From: Justin Pryzby <pryzby(at)telsasoft(dot)com>
To: Bharath Rupireddy <bharath(dot)rupireddyforpostgres(at)gmail(dot)com>
Cc: Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, Michael Paquier <michael(at)paquier(dot)xyz>, "Bossart, Nathan" <bossartn(at)amazon(dot)com>, pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: add recovery, backup, archive, streaming etc. activity messages to server logs along with ps display
Date: 2021-12-26 00:20:54
Message-ID: 20211226002054.GJ17618@telsasoft.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Fri, Dec 24, 2021 at 08:04:08PM +0530, Bharath Rupireddy wrote:
> On Fri, Dec 24, 2021 at 7:19 PM Justin Pryzby <pryzby(at)telsasoft(dot)com> wrote:
> > On Sun, Dec 12, 2021 at 06:08:05PM +0530, Bharath Rupireddy wrote:
> > > Another idea could be to use the infrastructure laid out by the commit
> > > 9ce346e [1]. With ereport_startup_progress, we can emit the LOGs(of
> > > current recovering WAL file) for every log_startup_progress_interval
> > > seconds/milliseconds.
> > >
> > > One problem is that ereport_startup_progress doesn't work on
> > > StandbyMode, maybe we can remove this restriction unless we have a
> > > major reason for not allowing it on the standby.
> > > /* Prepare to report progress of the redo phase. */
> > > if (!StandbyMode)
> > > begin_startup_progress_phase();
> >
> > The relevant conversation starts here.
> > https://www.postgresql.org/message-id/20210814214700.GO10479%40telsasoft.com
> >
> > There was a lot of confusion in that thread, though.
> >
> > The understanding was that it didn't make sense for that feature to
> > continuously log messages on a standby (every 10sec by default). That seems
> > like too much - the issue of a checkpointed logged every 5min was enough of a
> > hurdle.
> >
> > If you're talking about a new feature that uses the infrastructre from 9ce3,
> > but is controlled by a separate GUC like log_wal_traffic, that could be okay.
>
> Do you see any problems using the same GUC
> log_startup_progress_interval and ereport_startup_progress API
> introduced by 9ce346e? I prefer this instead of a new GUC. Thoughts?

I referenced the thread where we avoided writing progress logs during normal
operation of a standby, since the logs would be both useless and excessive.

If your patch were to use the same infrastructure, you'd still want to avoid
disturbing that behavior and writing useless logs.

--
Justin

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Dilip Kumar 2021-12-26 02:01:37 Re: Throttling WAL inserts when the standby falls behind more than the configured replica_lag_in_bytes
Previous Message Justin Pryzby 2021-12-26 00:20:00 Re: correct the sizes of values and nulls arrays in pg_control_checkpoint