From: | "Ram Ravichandran" <ramkaka(at)gmail(dot)com> |
---|---|
To: | "Greg Smith" <gsmith(at)gregsmith(dot)com> |
Cc: | pgsql-general(at)postgresql(dot)org |
Subject: | Re: turning fsync off for WAL |
Date: | 2008-06-03 03:40:37 |
Message-ID: | c8cd6fbb0806022040q3d8c418epf0d708686301ed66@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
>
>
>> Are you sure this will work correctly for database use at all? The known
> issue listed at http://www.persistentfs.com/documentation/Release_Notessounded like a much bigger consistancy concern than the fsync trivia you're
> bringing up:
>
> "In the current Technology Preview release, any changes to an open file's
> meta data are not saved to S3 until the file is closed. As a result, if
> PersistentFS or the system crashes while writing a file, it is possible for
> the file size in the file's directory entry to be greater than the actual
> number of file blocks written to S3..."
>
> This sounds like you'll face potential file corruption every time the
> database goes down for some reason, on whatever database files happen to be
> open at the time.
>
> Given the current state of EC2, I don't know why you'd take this approach
> instead of just creating an AMI to install the database into.
>
> --
> * Greg Smith gsmith(at)gregsmith(dot)com http://www.gregsmith.com Baltimore, MD
>
The problem that I am facing is that EC2 has no persistent storage (at least
currently). So, if the server restarts for some reason, all data on the
local disks are gone. The idea was to store the tables on the non-persistent
local disk, and do the WAL on to an S3 mounted drive. If the server goes
down for some reason, I was hoping to recover by replaying the WAL. I was
hoping that by faking the fsyncs, I would not incur the actual charges from
Amazon until the file system writes into S3.
Also, since WAL is on a separate FS, it will not affect my disk-write
rates.
Ram
From | Date | Subject | |
---|---|---|---|
Next Message | Hiroshi Saito | 2008-06-03 03:45:55 | Re: FW: make rows unique across db's without UUIP on windows? |
Previous Message | Sushant Sinha | 2008-06-03 03:13:49 | Re: [GENERAL] Fragments in tsearch2 headline |