Re: pg_dump additional options for performance

From: "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Jeff Davis <pgsql(at)j-davis(dot)com>, Simon Riggs <simon(at)2ndquadrant(dot)com>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: pg_dump additional options for performance
Date: 2008-02-26 19:08:31
Message-ID: 20080226110831.2957271c@commandprompt.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Tue, 26 Feb 2008 13:58:25 -0500
Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:

> "Joshua D. Drake" <jd(at)commandprompt(dot)com> writes:
> > IMO the place to start is COPY which is per my tests, slow. Multi
> > worker connection restore is great and I have proven that with some
> > work it can provide o.k. results but it is certainly not acceptable.
>
> It was already pointed out to you that we can hope for only
> incremental speedups in COPY per se. Don't be too quick to dismiss
> the discussion of large-grain parallelism, because I don't see
> anything else within reach that might give integer multiples rather
> than percentage points.

Oh please don't think I don't think this discussion is important, I
do. I would just hate to see us have 3 corners of a foundation. I also
don't buy the "incremental speedups". This may be arrogant of me but
that type of thought process is what allows for mediocre results.

HOT works because EDB refused to accept the inherit limitations of
PostgreSQL. COPY is no different in that aspect. Maybe it can't go
exponentially faster but the math says, "if done correctly, it can". We
just haven't figured out how.

Sincerely,

Joshua D. Drake

>
> regards, tom lane
>

- --
The PostgreSQL Company since 1997: http://www.commandprompt.com/
PostgreSQL Community Conference: http://www.postgresqlconference.org/
Donate to the PostgreSQL Project: http://www.postgresql.org/about/donate
PostgreSQL SPI Liaison | SPI Director | PostgreSQL political pundit

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFHxGOxATb/zqfZUUQRAs3oAJ4vpHEiRDUXPm1wqHWyIigVevoTbwCeJXa0
8bZAkOntTC9i/AHC3/L5w+8=
=gsUl
-----END PGP SIGNATURE-----

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Josh Berkus 2008-02-26 19:11:32 Re: Including PL/PgSQL by default
Previous Message Tom Lane 2008-02-26 18:58:25 Re: pg_dump additional options for performance