Re: How to best use 32 15k.7 300GB drives?

From: Віталій Тимчишин <tivv00(at)gmail(dot)com>
To: Scott Carey <scott(at)richrelevance(dot)com>
Cc: Stephen Frost <sfrost(at)snowman(dot)net>, Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>, Robert Schnabel <schnabelr(at)missouri(dot)edu>, "david(at)lang(dot)hm" <david(at)lang(dot)hm>, pgsql-performance <pgsql-performance(at)postgresql(dot)org>
Subject: Re: How to best use 32 15k.7 300GB drives?
Date: 2011-01-30 16:26:24
Message-ID: AANLkTikWy+U5qK88EhefVo1c-jRTe4gs-01X528XtFKn@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

2011/1/28 Scott Carey <scott(at)richrelevance(dot)com>

>
>
> On 1/28/11 9:28 AM, "Stephen Frost" <sfrost(at)snowman(dot)net> wrote:
>
> >* Scott Marlowe (scott(dot)marlowe(at)gmail(dot)com) wrote:
> >> There's nothing wrong with whole table updates as part of an import
> >> process, you just have to know to "clean up" after you're done, and
> >> regular vacuum can't fix this issue, only vacuum full or reindex or
> >> cluster.
> >
> >Just to share my experiences- I've found that creating a new table and
> >inserting into it is actually faster than doing full-table updates, if
> >that's an option for you.
>
> I wonder if postgres could automatically optimize that, if it thought that
> it was going to update more than X% of a table, and HOT was not going to
> help, then just create a new table file for XID's = or higher than the one
> making the change, and leave the old one for old XIDs, then regular VACUUM
> could toss out the old one if no more transactions could see it.
>
>
> I was thinking if a table file could be deleted if it has no single live
row. And if this could be done by vacuum. In this case vacuum on table that
was fully updated recently could be almost as good as cluster - any scan
would skip such non-existing files really fast. Also almost no disk space
would be wasted.

--
Best regards,
Vitalii Tymchyshyn

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Robert Haas 2011-01-30 19:25:23 Re: pgbench - tps for Postgresql-9.0.2 is more than tps for Postgresql-8.4.1
Previous Message Greg Smith 2011-01-29 00:27:09 Re: Migrating to Postgresql and new hardware