Re: Parallel Inserts in CREATE TABLE AS

From: Dilip Kumar <dilipbalaut(at)gmail(dot)com>
To: Bharath Rupireddy <bharath(dot)rupireddyforpostgres(at)gmail(dot)com>
Cc: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>, "Hou, Zhijie" <houzj(dot)fnst(at)cn(dot)fujitsu(dot)com>, Luc Vlaming <luc(at)swarm64(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, Zhihong Yu <zyu(at)yugabyte(dot)com>, vignesh C <vignesh21(at)gmail(dot)com>
Subject: Re: Parallel Inserts in CREATE TABLE AS
Date: 2020-12-30 05:19:38
Message-ID: CAFiTN-tAUQna6OVLU=W4qObRwUMkHkVvmeprJHFnteVOwuZ1iA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, 30 Dec 2020 at 10:47 AM, Bharath Rupireddy <
bharath(dot)rupireddyforpostgres(at)gmail(dot)com> wrote:

> On Wed, Dec 30, 2020 at 10:32 AM Dilip Kumar <dilipbalaut(at)gmail(dot)com>
> wrote:
> > I have completed reviewing 0001, I don't have more comments, just one
> > question. Soon I will review the remaining patches.
>
> Thanks.
>
> > + /* If parallel inserts are to be allowed, set a few extra
> information. */
> > + if (myState->is_parallel)
> > + {
> > + myState->object_id = intoRelationAddr.objectId;
> > +
> > + /*
> > + * We don't need to skip contacting FSM while inserting tuples
> for
> > + * parallel mode, while extending the relations, workers
> instead of
> > + * blocking on a page while another worker is inserting, can
> check the
> > + * FSM for another page that can accommodate the tuples. This
> results
> > + * in major benefit for parallel inserts.
> > + */
> > + myState->ti_options = 0;
> >
> > Is there any performance data for this or just theoretical analysis?
>
> I have seen that we don't get much performance with the skip fsm
> option, though I don't have the data to back it up. I'm planning to
> run performance tests after the patches 0001, 0002 and 0003 get
> reviewed. I will capture the data at that time. Hope that's fine.

Yeah that’s fine

> --
Regards,
Dilip Kumar
EnterpriseDB: http://www.enterprisedb.com

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tang, Haiying 2020-12-30 05:57:52 RE: [Patch] Optimize dropping of relation buffers using dlist
Previous Message Bharath Rupireddy 2020-12-30 05:17:13 Re: Parallel Inserts in CREATE TABLE AS