From: | "Jim C(dot) Nasby" <jim(at)nasby(dot)net> |
---|---|
To: | Adam Siegel <adam(at)sycamorehq(dot)com> |
Cc: | pgsql-hackers(at)postgresql(dot)org, pgsql-performance(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org |
Subject: | Re: realtime data inserts |
Date: | 2003-05-10 17:08:33 |
Message-ID: | 20030510120833.K66185@flake.decibel.org |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general pgsql-hackers pgsql-performance |
Are you binding your insert? IE:
prepare statement INSERT INTO blah VALUES (?, ?, ?);
execute statement (a, b, c)
Instead of just "INSERT INTO blah VALUES(a, b, c)"
On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote:
> I have realtime data flowing at a rate of 500, 512 byte packets per second.
> I want to log the info in a database table with two other columns, one for a
> timestamp and one for a name of the packet. The max rate I can achieve is
> 350 inserts per second on a sun blade 2000. The inserts are grouped in a
> transaction and I commit every 1200 records. I am storing the binary data
> in a bytea. I am using the libpq conversion function. Not sure if that is
> slowing me down. But I think it is the insert not the conversion.
>
> Any thoughts on how to achive this goal?
--
Jim C. Nasby (aka Decibel!) jim(at)nasby(dot)net
Member: Triangle Fraternity, Sports Car Club of America
Give your computer some brain candy! www.distributed.net Team #1828
Windows: "Where do you want to go today?"
Linux: "Where do you want to go tomorrow?"
FreeBSD: "Are you guys coming, or what?"
From | Date | Subject | |
---|---|---|---|
Next Message | Jim C. Nasby | 2003-05-10 17:19:33 | Re: pg_dump && tar && /tmp |
Previous Message | Ericson Smith | 2003-05-10 16:02:18 | Re: realtime data inserts |
From | Date | Subject | |
---|---|---|---|
Next Message | Jim C. Nasby | 2003-05-10 17:12:23 | Re: Plans for index names unique to a table? |
Previous Message | Tom Lane | 2003-05-10 16:10:08 | Re: Plans for index names unique to a table? |
From | Date | Subject | |
---|---|---|---|
Next Message | Ron Johnson | 2003-05-10 18:31:30 | Re: realtime data inserts |
Previous Message | Ericson Smith | 2003-05-10 16:02:18 | Re: realtime data inserts |