Re: ZSON, PostgreSQL extension for compressing JSONB

From: Oleg Bartunov <obartunov(at)gmail(dot)com>
To: Simon Riggs <simon(at)2ndquadrant(dot)com>
Cc: Aleksander Alekseev <a(dot)alekseev(at)postgrespro(dot)ru>, Postgresql General <pgsql-general(at)postgresql(dot)org>
Subject: Re: ZSON, PostgreSQL extension for compressing JSONB
Date: 2016-10-04 13:58:40
Message-ID: CAF4Au4zH6zLvkcJPDNFpS4+NQ+ibhB5A3eXFjCCv==s-NOyeFg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Tue, Oct 4, 2016 at 4:20 PM, Simon Riggs <simon(at)2ndquadrant(dot)com> wrote:

> On 30 September 2016 at 16:58, Aleksander Alekseev
> <a(dot)alekseev(at)postgrespro(dot)ru> wrote:
>
> > I've just uploaded ZSON extension on GitHub:
> >
> > https://github.com/afiskon/zson
> >
> > ZSON learns on your common JSONB documents and creates a dictionary
> > with strings that are frequently used in all documents. After that you
> > can use ZSON type to compress documents using this dictionary. When
> > documents schema evolve and compression becomes inefficient you can
> > re-learn on new documents. New documents will be compressed with a new
> > dictionary, old documents will be decompressed using old dictionary.
> >
> > In some cases ZSON can save half of your disk space and give you about
> > 10% more TPS. Everything depends on your data and workload though.
> > Memory is saved as well. For more details see README.md.
> >
> > Please don't hesitate to ask any questions. Any feedback and pull
> > requests are welcome too!
>
> Very good. Oleg had mentioned that dictionary compression was being
> considered.
>
> It would be useful to be able to define compression dictionaries for
> many use cases.
>

Dictionary compression is a different project, we'll publish it after
testing.

>
> Will you be submitting this to core?
>
> --
> Simon Riggs http://www.2ndQuadrant.com/
> PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
>
>
> --
> Sent via pgsql-general mailing list (pgsql-general(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general
>

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Robert Stone 2016-10-04 14:45:12 Re: Graphical entity relation model
Previous Message Simon Riggs 2016-10-04 13:20:44 Re: ZSON, PostgreSQL extension for compressing JSONB