| From: | "Nigel J(dot) Andrews" <nandrews(at)investsystems(dot)co(dot)uk> |
|---|---|
| To: | pgsql-general <pgsql-general(at)postgresql(dot)org> |
| Subject: | Re: COPY performance |
| Date: | 2002-04-13 18:19:21 |
| Message-ID: | Pine.LNX.4.21.0204131916080.3278-100000@ponder.fairway2k.co.uk |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-admin pgsql-general |
On Sat, 13 Apr 2002, Nigel J. Andrews wrote:
>
>
> I'm trying to COPY in a table of 1 million rows. The table is created by:
>
> [sniped]
>
> mmap()ed, STDIN can be special cased surely, and how about all the CPU power
> required for the ascii to internal representations being so high in a process
> that I would have thought to be very nearly IO bound?
>
> I could take a look at the code, not something I've done yet I must admit, and
> see if I can contribute by doing the mmap business if it's seen as a good idea.
I forgot to mention that even with 99% of the CPU it still takes a pretty long
time to load 300,000 rows, it's still working on the second batch and I think I
kicked the first off 30-60 minutes ago.
Also:
=>select version();
version
----------------------------------------------------------------------
PostgreSQL 7.2.1 on i386-unknown-freebsd3.3, compiled by GCC 2.7.2.3
--
Nigel J. Andrews
Director
---
Logictree Systems Limited
Computer Consultants
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Joe Conway | 2002-04-13 18:38:40 | Re: COPY performance |
| Previous Message | Nigel J. Andrews | 2002-04-13 18:13:06 | COPY performance |
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Joe Conway | 2002-04-13 18:38:40 | Re: COPY performance |
| Previous Message | Nigel J. Andrews | 2002-04-13 18:13:06 | COPY performance |