Re: Very big insert/join performance problem (bacula)

From: Marc Cousin <cousinmarc(at)gmail(dot)com>
To: pgsql-performance(at)postgresql(dot)org
Subject: Re: Very big insert/join performance problem (bacula)
Date: 2009-07-14 05:54:38
Message-ID: 200907140754.38785.cousinmarc@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

>
> While this is not your questions, I still noticed you seem to be on 8.3 -
> it might be a bit faster to use GROUP BY instead of DISTINCT.
It didn't do a big difference, I already tried that before for this query.
Anyway, as you said, it's not the query having problems :)

> Your effective_cache_size is really small for the system you seem to have -
> its the size of IO caching your os is doing and uses no resources itself.
> And 800MB of that on a system with that amount of data seems a bit unlikely
> ;-)
>
> Using `free` you can see the amount of io caching your OS is doing atm. in
> the 'cached' column.
>
> That possibly might tip some plans in a direction you prefer.
>
> What kind of machine are you running this on?

I played with this parameter too, and it didn't influence the plan. Anyway, the
doc says it's the OS cache available for one query, and there may be a lot of
insert queries at the same time, so I chose to be conservative with this
value. I tried it with 8GB too, the plans were the same.

The OS cache is around 8-10GB by the way.

The machine is a dell PE2900, with 6 disks dedicated to this database (raid 10
config)

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Richard Huxton 2009-07-14 08:15:21 Re: Very big insert/join performance problem (bacula)
Previous Message Frank Joerdens 2009-07-13 20:46:08 Odd performance / query plan with bitmasked field as opposed to equality