Re: Getting even more insert performance (250m+rows/day)

From: Markus Schaber <schabi(at)logix-tt(dot)com>
To: "Daniel J(dot) Luke" <dluke(at)geeklair(dot)net>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Getting even more insert performance (250m+rows/day)
Date: 2006-05-29 11:11:13
Message-ID: 447AD6D1.3070904@logix-tt.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

Hi, Daniel,

Daniel J. Luke wrote:

> One big transaction every 5 minutes using 'COPY FROM' (instead of
> inserts).

Are you using "COPY table FROM '/path/to/file'", having the file sitting
on the server, or "COPY table FROM STDIN" or psql "/copy", having the
file sitting on the client?

From our tests, having the file on the server can speed up the things by
factor 2 or 3 in some cases.

Also, using BINARY copy may give great benefits due to lower parsing
overhead.

As you say you're I/O bound, spreading tables, indices, wal and input
file to different spindles won't help you much.

HTH
Markus

--
Markus Schaber | Logical Tracking&Tracing International AG
Dipl. Inf. | Software Development GIS

Fight against software patents in EU! www.ffii.org www.nosoftwarepatents.org

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Cstdenis 2006-05-29 14:33:18 Re: How can I make this query faster (resend)
Previous Message chris smith 2006-05-29 10:36:43 Re: select with "like" from another table