Re: PostgreSQL disk fragmentation causes performance problems on Windows

From: Andres Freund <andres(at)anarazel(dot)de>
To: Jan Gunnar Dyrset <jan(dot)g(dot)dyrset(at)cybernetica(dot)no>
Cc: "pgsql-performance(at)postgresql(dot)org" <pgsql-performance(at)postgresql(dot)org>
Subject: Re: PostgreSQL disk fragmentation causes performance problems on Windows
Date: 2015-04-29 08:08:54
Message-ID: 20150429080854.GD14535@awork2.anarazel.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On 2015-04-29 10:06:39 +0200, Andres Freund wrote:
> Hi,
>
> On 2015-04-23 19:47:06 +0000, Jan Gunnar Dyrset wrote:
> > I am using PostgreSQL to log data in my application. A number of rows
> > are added periodically, but there are no updates or deletes. There are
> > several applications that log to different databases.
> >
> > This causes terrible disk fragmentation which again causes performance
> > degradation when retrieving data from the databases. The table files
> > are getting more than 50000 fragments over time (max table size about
> > 1 GB).
> >
> > The problem seems to be that PostgreSQL grows the database with only
> > the room it need for the new data each time it is added. Because
> > several applications are adding data to different databases, the
> > additions are never contiguous.
>
> Which OS and filesystem is this done on? Because many halfway modern
> systems, like e.g ext4 and xfs, implement this in the background as
> 'delayed allocation'.

Oh, it's in the subject. Stupid me, sorry for that. I'd consider testing
how much better this behaves under a different operating system, as a
shorter term relief.

Greetings,

Andres Freund

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Joshua D. Drake 2015-04-29 14:07:04 Re: PostgreSQL disk fragmentation causes performance problems on Windows
Previous Message Andres Freund 2015-04-29 08:06:39 Re: PostgreSQL disk fragmentation causes performance problems on Windows