From: | Kenneth Marshall <ktm(at)rice(dot)edu> |
---|---|
To: | "Godfrin, Philippe E" <Philippe(dot)Godfrin(at)nov(dot)com> |
Cc: | "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org> |
Subject: | Re: Inserts and bad performance |
Date: | 2021-11-24 19:20:10 |
Message-ID: | 20211124192010.GB8058@aart.rice.edu |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
On Wed, Nov 24, 2021 at 07:15:31PM +0000, Godfrin, Philippe E wrote:
> Greetings
> I am inserting a large number of rows, 5,10, 15 million. The python code commits every 5000 inserts. The table has partitioned children.
>
> At first, when there were a low number of rows inserted, the inserts would run at a good clip - 30 - 50K inserts per second. Now, after inserting oh say 1.5 Billion rows, the insert rate has dropped to around 5000 inserts per second. I dropped the unique index , rebuilt the other indexes and no change. The instance is 16 vcpu and 64GB ram.
>
> I'm perplexed, I can't see to find any reason for the slow down...
> Thanks,
> pg
Hi,
With not much information, it may be I/O related. CPU and RAM cannot fix
that once items need to be written to disk. Are there any errors in the
logs or CPUs maxxed out?
Regards,
Ken
From | Date | Subject | |
---|---|---|---|
Next Message | Godfrin, Philippe E | 2021-11-24 19:30:01 | RE: [EXTERNAL] Re: Inserts and bad performance |
Previous Message | Godfrin, Philippe E | 2021-11-24 19:15:31 | Inserts and bad performance |