From: | Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com> |
---|---|
To: | Павел Филонов <filonovpv(at)gmail(dot)com> |
Cc: | pgsql-general <pgsql-general(at)postgresql(dot)org> |
Subject: | Re: Why insertion throughput can be reduced with an increase of batch size? |
Date: | 2016-08-23 14:04:50 |
Message-ID: | bc8e791b-4b62-f69a-f847-12134a827c77@aklaver.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
On 08/22/2016 11:49 PM, Павел Филонов wrote:
Please reply to list also.
Ccing list
>
>
> 2016-08-23 4:02 GMT+03:00 Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com
> <mailto:adrian(dot)klaver(at)aklaver(dot)com>>:
>
> On 08/21/2016 11:53 PM, Павел Филонов wrote:
>
> My greetings to everybody!
>
> I recently faced with the observation which I can not explain. Why
> insertion throughput can be reduced with an increase of batch size?
>
> Brief description of the experiment.
>
> * PostgreSQL 9.5.4 as server
> * https://github.com/sfackler/rust-postgres
> <https://github.com/sfackler/rust-postgres> library as client driver
> * one relation with two indices (scheme in attach)
>
> Experiment steps:
>
> * populate DB with 259200000 random records
> * start insertion for 60 seconds with one client thread and
> batch size = m
> * record insertions per second (ips) in clients code
>
> Plot median ips from m for m in [2^0, 2^1, ..., 2^15] (in
> attachment).
>
>
> On figure with can see that from m = 128 to m = 256 throughput
> have been
> reduced from 13 000 ips to 5000.
>
> I hope someone can help me understand what is the reason for
> such behavior?
>
>
> To add to Jeff's questions:
>
> You say you are measuring the IPS in the clients code.
>
> Where is the client, on the same machine, same network or remote
> network?
>
>
> Postgres runs in docker and client runs on the host machine. Client
> connects to localhost interface.
I don't use Docker so I have no insights here.
>
>
> --
> Best regards
> Filonov Pavel
>
>
>
>
>
> --
> Adrian Klaver
> adrian(dot)klaver(at)aklaver(dot)com <mailto:adrian(dot)klaver(at)aklaver(dot)com>
>
>
>
>
> --
> С наилучшими пожеланиями,
> Филонов Павел
--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com
From | Date | Subject | |
---|---|---|---|
Next Message | Rakesh Kumar | 2016-08-23 14:06:11 | Re: question on error during COPY FROM |
Previous Message | Francisco Olarte | 2016-08-23 13:55:47 | Re: question on error during COPY FROM |