From: | Torsten Zuehlsdorff <mailinglists(at)toco-domains(dot)de> |
---|---|
To: | Vladimir Borodin <root(at)simply(dot)name>, Stephen Frost <sfrost(at)snowman(dot)net> |
Cc: | Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com>, Dinesh Chandra 12108 <Dinesh(dot)Chandra(at)cyient(dot)com>, "Madusudanan(dot)B(dot)N" <b(dot)n(dot)madusudanan(at)gmail(dot)com>, "pgsql-performance(at)postgresql(dot)org" <pgsql-performance(at)postgresql(dot)org> |
Subject: | Re: Backup taking long time !!! |
Date: | 2017-01-23 08:31:38 |
Message-ID: | c22085f2-b218-5270-1ca9-9288313049ff@toco-domains.de |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-performance |
Hello,
>>> Increments in pgbackrest are done on file level which is not really
>>> efficient. We have done parallelism, compression and page-level
>>> increments (9.3+) in barman fork [1], but unfortunately guys from
>>> 2ndquadrant-it don’t hurry to work on it.
>>
>> We're looking at page-level incremental backup in pgbackrest also. For
>> larger systems, we've not heard too much complaining about it being
>> file-based though, which is why it hasn't been a priority. Of course,
>> the OP is on 9.1 too, so.
>
> Well, we have forked barman and made everything from the above just
> because we needed ~ 2 PB of disk space for storing backups for our ~ 300
> TB of data. (Our recovery window is 7 days) And on 5 TB database it took
> a lot of time to make/restore a backup.
I just have around 11 TB but switched to ZFS based backups only. I'm
using snapshots therefore which gives some flexibility. I can rolback
them, i can just clone it and work with a full copy as a different
cluster (and just the differences are stored) and i can send them
incrementally to other servers. This is very fine for my use cases but
it doesn't fit everything of course.
Greetings,
Torsten
From | Date | Subject | |
---|---|---|---|
Next Message | Jim Nasby | 2017-01-23 15:10:00 | Re: optimizing immutable vs. stable function calls? |
Previous Message | Stephen Frost | 2017-01-23 06:48:39 | Re: Backup taking long time !!! |