Re: Best system for a data warehouse application

From: Jaime Soler <jaime(dot)soler(at)gmail(dot)com>
To: Fernando Hevia <fhevia(at)gmail(dot)com>
Cc: John Scalia <jayknowsunix(at)gmail(dot)com>, Postgres <pgsql-admin(at)postgresql(dot)org>
Subject: Re: Best system for a data warehouse application
Date: 2017-02-22 14:23:00
Message-ID: CAKVUGgTT_rGcZ2Gt5DAmobC9nY7Oxb3fhhuTUpO6fBDKtP4OJg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Well I prefer 1 choice, but first of choose a cpu model, I would check how
many concurrent connections use your DW system. Also if you prefer a
many-cores cpu, please check some previous errors related with cache line
conetention in large numa system:
https://www.enterprisedb.com/blog/solving-cache-line-contention-large-numa-systems

2017-02-22 3:15 GMT+01:00 Fernando Hevia <fhevia(at)gmail(dot)com>:

> Option 1 is best if you will handle but a few connections to postgres
> (~<=4), since the higher cpu clock will prevail in this scenario.
> But if you expect having more than a few simultaneous connections go with
> option 2 without a doubt.
> Check how many simultaneous connections your DW system typically uses and
> go from there. Although more cores would in general be the correct choice,
> keep in mind that common DW in-database computations will greatly profit
> from the extra cpu cycles of the 3.5 GHz cpu.
>
> Cheers.
>
>
> El 21 feb. 2017 2:39 PM, "John Scalia" <jayknowsunix(at)gmail(dot)com> escribió:
>
>> Hi all,
>>
>> One of my system admins has approached me about replacing our production
>> data warehouse system. I believe I know the answer, but would just like
>> more opinions. He's giving me two options so far:
>>
>> 1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreading
>>
>> vs.
>>
>> 2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreading
>>
>> The rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD
>> drives. Our data warehouse is just shy of 2Tb now. I suspect the the first
>> option would be more optimal as I don't think PostgreSQL can make effective
>> use of a lot of processor cores. So fewer cores would be better optimized
>> with the O/S. Can anyone weigh in on whether my assumptions are correct?
>> --
>> Jay
>>
>

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Jaime Soler 2017-02-22 14:33:59 Re: PGSQL as database server container
Previous Message Fernando Hevia 2017-02-22 02:15:15 Re: Best system for a data warehouse application