Re: slow insert speeds with bytea

From: Steve Atkins <steve(at)blighty(dot)com>
To: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: slow insert speeds with bytea
Date: 2019-12-02 16:01:28
Message-ID: 821991dd-f917-8402-471a-2d7f974ac801@blighty.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general


On 01/12/2019 17:59, Alex O'Ree wrote:
> Is there anything I can to increase insert speeds for bytea? Currently
> running postgres 9.6.15
>
> I have a few tables without a bytea and a few with bytea. There is a
> large performance difference with inserts between the two. I'm
> inserting a byte[] that's usually less than 1MB on content. The
> content itself is actually just utf8 string data.
>
> For the non-bytea table, inserts can be as high as 40k rows/sec,
> whereas the bytea table is closer to 4k/sec or less.

4k 1MB rows/sec would be 4GB a second. It would need to be a fairly
decent IO system to manage that speed, let alone ten times that.

What's the typical row size of the tables with bytea fields vs the other
tables?

What are your IO stats during the two sorts of insert?

Cheers,
  Steve

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Antonio Silva 2019-12-02 16:26:26 Re: using replace function
Previous Message Adrian Klaver 2019-12-02 15:52:16 Re: slow insert speeds with bytea