Re: [HACKERS] Custom compression methods

From: Dilip Kumar <dilipbalaut(at)gmail(dot)com>
To: Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>
Cc: Robert Haas <robertmhaas(at)gmail(dot)com>, Alexander Korotkov <a(dot)korotkov(at)postgrespro(dot)ru>, David Steele <david(at)pgmasters(dot)net>, Ildus Kurbangaliev <i(dot)kurbangaliev(at)gmail(dot)com>, Dmitry Dolgov <9erthalion6(at)gmail(dot)com>, PostgreSQL Developers <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: [HACKERS] Custom compression methods
Date: 2020-10-29 06:37:16
Message-ID: CAFiTN-tCmwGa_Bp-eR+_LHNa5MjGs375z1x4vy4VQXDWg3YBKA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Thu, Oct 29, 2020 at 12:31 AM Tomas Vondra
<tomas(dot)vondra(at)2ndquadrant(dot)com> wrote:
>
> On Wed, Oct 28, 2020 at 01:16:31PM +0530, Dilip Kumar wrote:
> >>
> >> ...
> >>
> >> I have added the next patch to support the compression options. I am
> >> storing the compression options only for the latest compression
> >> method. Basically, based on this design we would be able to support
> >> the options which are used only for compressions. As of now, the
> >> compression option infrastructure is added and the compression options
> >> for inbuilt method pglz and the external method zlib are added. Next,
> >> I will work on adding the options for the lz4 method.
> >
> >In the attached patch set I have also included the compression option
> >support for lz4. As of now, I have only supported the acceleration
> >for LZ4_compress_fast. There is also support for the dictionary-based
> >compression but if we try to support that then we will need the
> >dictionary for decompression also. Since we are only keeping the
> >options for the current compression methods, we can not support
> >dictionary-based options as of now.
> >
>
> OK, thanks. Do you have any other plans to improve this patch series? I
> plan to do some testing and review, but if you're likely to post another
> version soon then I'd wait a bit.

There was some issue in create_compression_method.sgml and the
drop_compression_method.sgml was missing. I have fixed that in the
attached patch. Now I am not planning to change anything soon so you
can review. Thanks.

--
Regards,
Dilip Kumar
EnterpriseDB: http://www.enterprisedb.com

Attachment Content-Type Size
v12-0002-alter-table-set-compression.patch application/octet-stream 12.8 KB
v12-0001-Built-in-compression-method.patch application/octet-stream 200.8 KB
v12-0005-new-compression-method-extension-for-zlib.patch application/octet-stream 9.8 KB
v12-0004-Create-custom-compression-methods.patch application/octet-stream 44.7 KB
v12-0003-Add-support-for-PRESERVE.patch application/octet-stream 40.4 KB
v12-0006-Support-compression-methods-options.patch application/octet-stream 43.8 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Bharath Rupireddy 2020-10-29 06:45:04 Re: Log message for GSS connection is missing once connection authorization is successful.
Previous Message Fujii Masao 2020-10-29 06:21:57 Re: Use standard SIGHUP and SIGTERM handlers in autoprewarm module