Re: SSD gives disappointing speed up on OSX

From: Josh berkus <josh(at)agliodbs(dot)com>
To: Bill Ross <ross(at)cgl(dot)ucsf(dot)edu>, pgsql-general(at)postgresql(dot)org
Subject: Re: SSD gives disappointing speed up on OSX
Date: 2016-02-03 03:53:06
Message-ID: 56B179A2.6090602@agliodbs.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 02/02/2016 07:32 PM, Bill Ross wrote:
> I have a program that inserts 50M records of about 30 bytes each, with
> some simple indexing, using about 5 GB of disk, layout shown below. When
> I run the program without the inserts, it takes a few seconds to do just
> the calculation part.
>
> With inserts, it takes about 90 minutes to run on my macbook pro (2012)
> with a spinning disk and 8G memory. Since CPU was running at 40% idle, I
> figured this must be due to waiting on disk, so I swapped in an SSD. Now
> on the console I see 6 Mb/s negotiated link speed on disk, vs. 3 Mb/s
> before.

So, your basic problem is going to be that OSX doesn't have a decent
filesystem to offer. HFS+ was created 18 years ago, and it was a hack
on top of an older HFS. At its heart, it's still basically a DOS-era
16-bit filesystem. This means that as long as you are on Mac OS, you
can assume that writes will be slow no matter how good your hardware is.

Supposedly you can still run ZFS on OSX, which might help you. I
haven't done it, though.

--
--
Josh Berkus
Red Hat OSAS
(any opinions are my own)

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Chris Mair 2016-02-03 10:36:48 Re: SSD gives disappointing speed up on OSX
Previous Message Bill Ross 2016-02-03 03:32:00 SSD gives disappointing speed up on OSX