Re: Performance large tables.

To be more specific, there are two types of commands that are run on
the system. There are application commands that do all different types
of joins and etc but for the most part are fast enough to meet user
expectations. On the other hand there is a weekly update (This is the
problem) that updates all of the modified records for a bunch of
finacial data such as closes and etc. For the most part they are
records of the type name,date,value. The update currently takes almost
two days. The update does deletions, insertion, and updates depending
on what has happened from the previous week.

For the most part the updates are simple one liners. I currently commit
in large batch to increase performance but it still takes a while as
stated above. From evaluating the computers performance during an
update, the system is thrashing both memory and disk. I am currently
using Postgresql 8.0.3.

Example command "UPDATE data where name=x and date=y;".

Martijn van Oosterhout wrote:

>On Sat, Dec 10, 2005 at 03:22:47PM -0800, Benjamin Arai wrote:
>
>
>>My issue actually stems from the fact that I cannot do large weekly
>>updates on fast enough to meet a weekend window for the following work
>>week. I am currently using a machine with a raid 1, 4GB RAM, and dual
>>opteron. I could go 0+1 but peroformance increase is only about 20%
>>from the benchmarks I have read. ANY suggestions would be greatly
>>appreciated.
>>
>>
>
>Since you have given us no information to work with you're not going to
>get any specific recommendations either. If you can tell is the things
>you do most commonly and are most performance sensetive (exact
>commands, timings, versions and settings please) we may be able to
>help.
>
>