| From: | "Ivan N(dot) Ivanov" <ivan(dot)ni(at)telebid-pro(dot)com> |
|---|---|
| To: | "vijaykumarjain(dot)github(at)gmail(dot)com" <vijaykumarjain(dot)github(at)gmail(dot)com>, "ronljohnsonjr(at)gmail(dot)com" <ronljohnsonjr(at)gmail(dot)com> |
| Cc: | pgsql-general(at)lists(dot)postgresql(dot)org |
| Subject: | Re: [(catch-ext)] Re: Setting up streaming replication on large database (20+ TB) for the first time |
| Date: | 2022-08-18 07:32:26 |
| Message-ID: | CAC+=vAw99nbust7BCwwU=c=uuL8pNrC5NnOiJmJx5mt9ypbtiw@mail.gmail.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-general |
Thank you, people. The big problem in my case, which I have not mentioned,
is that I think the network is a bottleneck, because I am running
pg_basebackup through internet from local country to Amazon instance in
Germany and the speed in copying is around 50 MB/sec max, that is why it
takes 2 days for copying.
I will try using high compression for the basebackup to reduce the time.
pgbackrest is an alternative, too
Thank you again!
On Wed, Aug 17, 2022 at 11:13 PM Ivan N. Ivanov <ivan(dot)ni(at)telebid-pro(dot)com>
wrote:
> Thank you for your answer! I have found this tool and I will try it
> tomorrow to see if this "read-ahead" feature will speed up the process.
>
> On Wed, Aug 17, 2022 at 11:09 PM Christophe Pettus <xof(at)thebuild(dot)com>
> wrote:
>
>>
>>
>> > On Aug 17, 2022, at 13:06, Ivan N. Ivanov <ivan(dot)ni(at)telebid-pro(dot)com>
>> wrote:
>> >
>> > How to speed up recovering of WAL files?
>>
>> Since you are running on your own hardware, you might take a look at:
>>
>> https://github.com/TritonDataCenter/pg_prefaulter
>>
>
| From | Date | Subject | |
|---|---|---|---|
| Next Message | hubert depesz lubaczewski | 2022-08-18 08:58:22 | Re: Is it possible to keep indexes on different disk location? |
| Previous Message | Vijaykumar Jain | 2022-08-18 06:43:15 | Re: Setting up streaming replication on large database (20+ TB) for the first time |