Re: Disk latency goes up during certaing pediods

From: German Becker <german(dot)becker(at)gmail(dot)com>
To: Brett Stauner <brett(at)mightybs(dot)net>
Cc: Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>, "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org>
Subject: Re: Disk latency goes up during certaing pediods
Date: 2013-07-29 17:58:01
Message-ID: CALyjCLtOkjtiF1jszVM33EYJfZB_9LOonvZj9RP8EzOo0fzLMw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Brett,

Yes I'm not impying it is postgres related, perhaps is even a normal thing
of ext3 /ext4 filesystem, but, this behavioiur is only notable when using
postgres and in particular the wal files, as it is very hard disk
intensive, soy maybe somenone has seen this befores. The server only task
is the database. It has 4 disks one for the os, one for the wal and the
other 2 for data. All disks show different access times. The WAL disk is
the only one on which the with constant latency, and in certain ocasions it
goes up.
Plus the ocasions are absolutely random.

On Mon, Jul 29, 2013 at 1:15 PM, Brett Stauner <brett(at)mightybs(dot)net> wrote:

> "...like if the disk/filesystem gets slower during one hour or so"
>
> What about a different scheduled task on the system, not necessarily
> Postgres related?
>
>
> On Mon, Jul 29, 2013 at 9:17 AM, German Becker <german(dot)becker(at)gmail(dot)com>wrote:
>
>> Alvaro,
>>
>> Thanks for your reply. I believe that the only possibility is autovacum
>> activity I will check that. Anyway what puzzles me is that
>> the throughput does not increase like i might expect if there where high
>> VACUUM activity, only the WAIT TIME and thus the UTILIZATION. Is like if
>> the disk/filesystem gets slower during one hour or so...
>>
>>
>> On Fri, Jul 26, 2013 at 5:27 PM, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com
>> > wrote:
>>
>>> German Becker escribió:
>>> > Hi list,
>>> >
>>> > I am running Postgres 9.1 on Ubuntu 12.04. I have a dedicated disk for
>>> > pg_xlog, using ext4 filesystem with journaling in writeback mode
>>> > During high load times, the disk usage is arround 40%. The IO write
>>> time is
>>> > constant at about 3ms. On certain occasions roughly once in 15 days,
>>> the
>>> > IO write time goes up to about 10ms. This makes the disk usage go up to
>>> > almost 100%, probably saturation, and the INSERTS DELETES UPDATES run
>>> > considerable slower than normal.This lasts for about 2 hours and then
>>> the
>>> > latency goes back to 3ms and everything is normal again.
>>> > Has anyone seen this behavior? What could be causing the increase in
>>> > latency?
>>>
>>> Can you correlate these episodes with autovacuum activity? Or perhaps
>>> backups are being taken (maybe a new base backup is taken every 15
>>> days)?
>>>
>>> --
>>> Álvaro Herrera http://www.2ndQuadrant.com/
>>> PostgreSQL Development, 24x7 Support, Training & Services
>>>
>>
>>
>

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Brett Stauner 2013-07-29 18:01:23 Re: Disk latency goes up during certaing pediods
Previous Message Thomas Kellerer 2013-07-29 16:31:32 Re: Shell Script for Vacuum