Re: [GENERAL] Performance while loading data and indexing

From: Rod Taylor <rbt(at)rbt(dot)ca>
To: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
Cc: Neil Conway <neilc(at)samurai(dot)com>, Greg Copeland <greg(at)CopelandConsulting(dot)Net>, shridhar_daithankar(at)persistent(dot)co(dot)in, PostgresSQL Hackers Mailing List <pgsql-hackers(at)postgresql(dot)org>, PostgresSQL General Mailing List <pgsql-general(at)postgresql(dot)org>
Subject: Re: [GENERAL] Performance while loading data and indexing
Date: 2002-09-26 21:45:23
Message-ID: 1033076723.27772.4.camel@jester
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

On Thu, 2002-09-26 at 17:39, Bruce Momjian wrote:
> Neil Conway wrote:
> > Greg Copeland <greg(at)CopelandConsulting(dot)Net> writes:
> > > On Thu, 2002-09-26 at 16:03, Neil Conway wrote:
> > > > I'm not really familiar with the reasoning behind ext2's
> > > > reputation as recovering poorly from crashes; if we fsync a WAL
> > > > record to disk before we lose power, can't we recover reliably,
> > > > even with ext2?
> > >
> > > Well, I have experienced data loss from ext2 before. Also, recovery
> > > from crashes on large file systems take a very, very long time.
> >
> > Yes, but wouldn't you face exactly the same issues if you ran a
> > UFS-like filesystem in asynchronous mode? Albeit it's not the default,
> > but performance in synchronous mode is usually pretty poor.
>
> Yes, before UFS had soft updates, the synchronous nature of UFS made it
> slower than ext2, but now with soft updates, that performance difference
> is gone so you have two files systems, ext2 and ufs, similar peformance,
> but one is crash-safe and the other is not.

Note entirely true. ufs is both crash-safe and quick-rebootable. You
do need to fsck at some point, but not prior to mounting it. Any
corrupt blocks are empty, and are easy to avoid.

Someone just needs to implement a background fsck that will run on a
mounted filesystem.

--
Rod Taylor

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Bruce Momjian 2002-09-26 21:47:43 Re: [HACKERS] Performance while loading data and indexing
Previous Message Neil Conway 2002-09-26 21:44:06 Re: unlock / drop table

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruce Momjian 2002-09-26 21:47:43 Re: [HACKERS] Performance while loading data and indexing
Previous Message Bruce Momjian 2002-09-26 21:41:22 Re: [HACKERS] Performance while loading data and indexing

Browse pgsql-performance by date

  From Date Subject
Next Message Bruce Momjian 2002-09-26 21:47:43 Re: [HACKERS] Performance while loading data and indexing
Previous Message Bruce Momjian 2002-09-26 21:41:22 Re: [HACKERS] Performance while loading data and indexing