Re: vacuumdb idle processes

From: Nikhil Shetty <nikhil(dot)dba04(at)gmail(dot)com>
To: Jeff Janes <jeff(dot)janes(at)gmail(dot)com>
Cc: pgsql-admin <pgsql-admin(at)postgresql(dot)org>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Subject: Re: vacuumdb idle processes
Date: 2021-06-16 06:26:46
Message-ID: CAFpL5VxpgaaxRxcjmEHUdDyfSmjkX-OobW_mfWGPPs7cB6fMtQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Hi Jeff,

I don't think we **need** this behavior, it is just a simple way to wait
> for each one to finish and then close it; waiting for each specific one in
> the order it is present in the list. Is there an important reason we need
> a more complex behavior, closing each one as soon as it becomes idle once
> the work queue is empty?
>

Reason for releasing connections in my case would be the "autovacuum (to
prevent wraparound)" taking time to complete . This process should finish
to completion to prevent any issues in the databases due to wraparound and
it will take some time if the table is big and contains many dead tuples.
If vacuumdb starts with 10 parallel jobs during this period, one of the
jobs will be locked(by autovacuum) and the other nine will be idle(after
finishing their part) for days just wasting connections until we terminate
the locked process.

Thanks and Regards,
Nikhil

On Wed, Jun 16, 2021 at 1:50 AM Jeff Janes <jeff(dot)janes(at)gmail(dot)com> wrote:

> On Sun, Jun 13, 2021 at 8:43 AM Nikhil Shetty <nikhil(dot)dba04(at)gmail(dot)com>
> wrote:
>
>> Hi,
>>
>> I tested this scenario and it seems if vacuumdb is started with multiple
>> jobs and one of the jobs doesn't complete due to a lock or whatever reason,
>> other jobs will stay idle and don't release the connection until the stuck
>> job is finished.
>>
>> For my understanding, why do we need this behaviour?
>>
>
> I don't think we **need** this behavior, it is just a simple way to wait
> for each one to finish and then close it; waiting for each specific one in
> the order it is present in the list. Is there an important reason we need
> a more complex behavior, closing each one as soon as it becomes idle once
> the work queue is empty?
>
> Cheers,
>
> Jeff
>

In response to

Browse pgsql-admin by date

  From Date Subject
Next Message Massimo Ortensi 2021-06-16 08:11:37 compression in replication
Previous Message Wells Oliver 2021-06-16 01:52:53 Re: Dump & restore in directory format and permissions are largely lost?