Re: minio server. Was: Performance of ByteA: ascii vs binary

From: Thomas Güttler <guettliml(at)thomas-guettler(dot)de>
To: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: minio server. Was: Performance of ByteA: ascii vs binary
Date: 2019-03-19 08:24:44
Message-ID: 3f37e45a-9cc9-3226-c289-13eccbf803e3@thomas-guettler.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Am 18.03.19 um 17:52 schrieb Adrian Klaver:
> On 3/18/19 7:59 AM, Thomas Güttler wrote:
>>
>>
>> Am 18.03.19 um 15:49 schrieb Tom Lane:
>>> Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com> writes:
>>>> On 3/18/19 7:33 AM, Thomas Güttler wrote:
>>>>> If I used ascii data the tests took 52 seconds.
>>>>> If I used random binary data the test took 250 seconds.
>>>
>>> This doesn't seem terribly surprising in bytea_output = escape
>>> mode.  Probably with bytea_output = hex the performance would
>>> be less data-dependent.
>>
>> Thank you for your fast reply.
>>
>> I guess we will use a minio server to store the blobs.
>
> According to this:
>
> http://initd.org/psycopg/docs/usage.html?highlight=bytea#adapt-binary
>
> psycopg2 will use 'hex' by default.
>
> Have you tried the test outside Python/psycopg2 e.g in psql to see if the performance hit still exists?

No, I did not test it outside Python/psycopg2.

Since our code will use Python/psycopg2 I did not run a test outside.

The decision was made. Now I am busy learning minio. I use it for the first time.

Regards,
Thomas Güttler

--
Thomas Guettler http://www.thomas-guettler.de/
I am looking for feedback: https://github.com/guettli/programming-guidelines

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Alexandre Arruda 2019-03-19 12:26:18 Re: recovery_target_time and WAL fetch with streaming replication
Previous Message Adrian Klaver 2019-03-18 23:44:42 Re: [External] Re: postgresql-11 installation errors via deb package on ubuntu 16