Re: pgsql: aio: Infrastructure for io_method=worker

From: Andres Freund <andres(at)anarazel(dot)de>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: pgsql: aio: Infrastructure for io_method=worker
Date: 2025-03-18 23:07:53
Message-ID: 27fwadt6whe5ufqyrgbrnu3ppfiocaljtt3fufedn6sclvjqll@kotindcvgtoy
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers pgsql-hackers

Hi,

On 2025-03-18 18:53:48 -0400, Tom Lane wrote:
> Andres Freund <andres(at)anarazel(dot)de> writes:
> > To allow the number of IO workers to be increased without a restart, we need
> > to reserve PGPROC entries for the workers unconditionally. This has been
> > judged to be worth the cost. If it turns out to be problematic, we can
> > introduce a PGC_POSTMASTER GUC to control the maximum number.
>
> So I see this patch added 32 PGPROCs and hence 32 semaphores to the
> system's requirements.

Yea - I brought that suspicion up a few times in the thread and in the
resulting discussion it wasn't deemed worth introducing a PGC_POSTMASTER guc
to control the max.

> It's probably time to just abandon the idea of being able to run with
> only 60 semaphores.

Agreed. It's an absurdly outdated OS default configuration. Realistically one
can't run postgres even in a toy scenario without changing it. So the value of
being able to test postgres with the default OS settings doesn't seem that
high. If it were on a very commonly used platform I would think differently,
but net/openbsd ain't that.

> I wonder though if we ought to revert 38da05346 and/or 6d0154196 in view of
> that.

38da05346 doesn't seem to have much value if it doesn't help us run the tests
by default - but it also doesn't really hurt. So, shrug, I guess.

6d0154196 - a higher autovacuum_worker_slots increases resource usage more
than IO workers do, because autovac workers are included in computations like
lock space. But 16 isn't that much either way...

Greetings,

Andres Freund

In response to

Responses

Browse pgsql-committers by date

  From Date Subject
Next Message Michael Paquier 2025-03-18 23:11:39 pgsql: Optimize check for pending backend IO stats
Previous Message Tom Lane 2025-03-18 22:53:48 Re: pgsql: aio: Infrastructure for io_method=worker

Browse pgsql-hackers by date

  From Date Subject
Next Message Michael Paquier 2025-03-18 23:18:03 Re: query_id: jumble names of temp tables for better pg_stat_statement UX
Previous Message Tom Lane 2025-03-18 22:53:48 Re: pgsql: aio: Infrastructure for io_method=worker