Re: realtime data inserts

From: Ron Johnson <ron(dot)l(dot)johnson(at)cox(dot)net>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: realtime data inserts
Date: 2003-05-10 18:31:30
Message-ID: 1052591490.26574.161.camel@haggis
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

On Sat, 2003-05-10 at 11:00, Tom Lane wrote:
> "Adam Siegel" <adam(at)sycamorehq(dot)com> writes:
> > I have realtime data flowing at a rate of 500, 512 byte packets per second.
> > I want to log the info in a database table with two other columns, one for a
> > timestamp and one for a name of the packet. The max rate I can achieve is
> > 350 inserts per second on a sun blade 2000. The inserts are grouped in a
> > transaction and I commit every 1200 records.
>
> Have you thought about using COPY?

Generate a temporary file, and then system("COPY /tmp/foobar ...") ?

--
+---------------------------------------------------------------+
| Ron Johnson, Jr. mailto:ron(dot)l(dot)johnson(at)cox(dot)net |
| Jefferson, LA USA http://members.cox.net/ron.l.johnson |
| |
| The purpose of the military isn't to pay your college tuition |
| or give you a little extra income; it's to "kill people and |
| break things". Surprisingly, not everyone understands that. |
+---------------------------------------------------------------+

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message alex b. 2003-05-10 21:51:48 odd error...
Previous Message Mathieu Arnold 2003-05-10 17:36:28 Re: pg_dump && tar && /tmp

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2003-05-11 02:40:49 Re: Plans for index names unique to a table?
Previous Message Christopher Browne 2003-05-10 17:44:42 Re: Plans for index names unique to a table?

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2003-05-11 02:46:25 Re: realtime data inserts
Previous Message Jim C. Nasby 2003-05-10 17:08:33 Re: realtime data inserts