Re: FileFallocate misbehaving on XFS

From: Andres Freund <andres(at)anarazel(dot)de>
To: Michael Harris <harmic(at)gmail(dot)com>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, Jakub Wartak <jakub(dot)wartak(at)enterprisedb(dot)com>, Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, Tomas Vondra <tomas(at)vondra(dot)me>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: FileFallocate misbehaving on XFS
Date: 2024-12-31 15:31:25
Message-ID: au3cpxea2n3yqzk7cqvttr7ik46glm2n6uqqdo22gooixssfzh@wk3alx6yist2
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi,

On 2024-12-19 17:47:13 +1100, Michael Harris wrote:
> I have attached a file containing all the errors I collected. The
> error is happening pretty regularly - over 400 times in a ~6 hour
> period. The number of blocks being extended varies from ~9 to ~15, and
> the statfs result shows plenty of available space & inodes at the
> time. The errors do seem to come in bursts.

One interesting moment is this:

2024-12-19 01:59:39 CET [2559130]: LOG: mdzeroextend FileFallocate failing with ENOSPC: free space for filesystem containing "pg_tblspc/107724/PG_16_202307071/465960/3232056651" f_blocks: 2683831808, f_bfree: 198915036, f_bavail: 198915036 f_files: 1073741376, f_ffree: 1069932412
2024-12-19 01:59:39 CET [2559130]: ERROR: could not extend file "pg_tblspc/107724/PG_16_202307071/465960/3232056651" by 9 blocks, from 59723 to 59732, using FileFallocate(): No space left on device
2024-12-19 04:47:04 CET [2646363]: LOG: mdzeroextend FileFallocate failing with ENOSPC: free space for filesystem containing "pg_tblspc/107724/PG_16_202307071/465960/3232056651.2" f_blocks: 2683831808, f_bfree: 300862306, f_bavail: 300862306 f_files: 1073741376, f_ffree: 1069821450
2024-12-19 04:47:04 CET [2646363]: ERROR: could not extend file "pg_tblspc/107724/PG_16_202307071/465960/3232056651.2" by 11 blocks, from 29850 to 29861, using FileFallocate(): No space left on device

Note that there's
a) a few hours between messages, whereas previous they were more frequent
b) f_bfree increased substantially.

I assume that somewhere around 2AM some script prunes old partitions?

Greetings,

Andres Freund

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Pavel Stehule 2024-12-31 15:39:45 Re: SQLFunctionCache and generic plans
Previous Message Tomas Vondra 2024-12-31 15:20:48 Re: PoC: history of recent vacuum/checkpoint runs (using new hooks)