Re: Can we get rid of repeated queries from pg_dump?

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Laurenz Albe <laurenz(dot)albe(at)cybertec(dot)at>, depesz(at)depesz(dot)com, pgsql-general <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Can we get rid of repeated queries from pg_dump?
Date: 2021-08-27 22:27:20
Message-ID: 20210827222720.GV17906@tamriel.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

Greetings,

* Tom Lane (tgl(at)sss(dot)pgh(dot)pa(dot)us) wrote:
> Stephen Frost <sfrost(at)snowman(dot)net> writes:
> > * Tom Lane (tgl(at)sss(dot)pgh(dot)pa(dot)us) wrote:
> >> I experimented with the attached, very quick-n-dirty patch to collect
> >> format_type results during the initial scan of pg_type, instead. On the
> >> regression database in HEAD, it reduces the number of queries pg_dump
> >> issues from 3260 to 2905; but I'm having a hard time detecting any net
> >> performance change.
>
> > Seems like the issue here is mainly just the latency of each query being
> > rather high compared to most use-cases, so local testing where there's
> > basically zero latency wouldn't see any change in timing, but throw a
> > trans-atlantic or worse amount of latency between the system running
> > pg_dump and the PG server and you'd see notable wall-clock savings in
> > time.
>
> Yeah. What I was more concerned about was the potential downside
> of running format_type() for each pg_type row, even though we might
> use only a few of those results. The fact that I'm *not* seeing
> a performance hit with a local server is encouraging from that
> standpoint.

Ah, yes, agreed.

Thanks!

Stephen

In response to

Browse pgsql-general by date

  From Date Subject
Next Message ourdiaspora 2021-08-27 22:50:31 Re: use fopen unknown resource
Previous Message Tom Lane 2021-08-27 22:25:05 Re: Can we get rid of repeated queries from pg_dump?

Browse pgsql-hackers by date

  From Date Subject
Next Message Stephen Frost 2021-08-27 22:33:33 Re: New predefined roles- 'pg_read/write_all_data'
Previous Message Tom Lane 2021-08-27 22:25:05 Re: Can we get rid of repeated queries from pg_dump?