Overflow of bgwriter's request queue

From: ITAGAKI Takahiro <itagaki(dot)takahiro(at)lab(dot)ntt(dot)co(dot)jp>
To: pgsql-hackers(at)postgresql(dot)org
Subject: Overflow of bgwriter's request queue
Date: 2006-01-11 10:32:43
Message-ID: 20060111190502.4CDE.ITAGAKI.TAKAHIRO@lab.ntt.co.jp
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi Hackers,

I encountered overflow of bgwriter's file-fsync request queue. It occurred
during checkpoints. Each backend would call fsync disorderly in such cases,
so that the checkpoint takes a long time and the performance has decreased.
It seems to happen frequently on the machines with a lot of memories and
poor disks.

I assume that the cause of this problem is that AbsorbFsyncRequests is not
called for a long time during checkpoints. The attached patch is one of
the solutions for it. It eliminates duplicate requests when the queue
is full, with a simple sort and unique technique.

I hope this problem will be solved by some methods.

---
ITAGAKI Takahiro
NTT Cyber Space Laboratories

Attachment Content-Type Size
bgwriter-requests-queue-overflow.patch application/octet-stream 4.7 KB

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Milen Kulev 2006-01-11 14:42:32 PG process architecture
Previous Message Neil Conway 2006-01-11 08:06:07 Re: leaks in TopMemoryContext?