From: | Jean-Armel Luce <jaluce06(at)gmail(dot)com> |
---|---|
To: | Scott Ribe <scott_ribe(at)elevated-dev(dot)com> |
Cc: | Cédric Villemain <cedric(dot)villemain(dot)debian(at)gmail(dot)com>, "[ADMIN]" <pgsql-admin(at)postgresql(dot)org> |
Subject: | Re: rsync and streaming replication |
Date: | 2011-11-21 16:45:59 |
Message-ID: | CALnckSpFAnC_dcEEYxsf3fKd=eQ_2Mv3=MuGiqQfVRFg317d-w@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-admin |
Hi,
I did some benchs as suggested by Cedric.
At first, I rsynced with options rsync -r --ignore-times --stats -h, and
then I rsynced with options rsync -rc --stats -h
The total duration of 1st rsync (--ignore-times) for all my tablespaces is
24 min 24 sec.
Please find below details printed by rsync for 1 tablespace (size 107 Go
found using du -h) ;
For this tablespace, duration was 17 minutes 20 seconds.
=====================================
Mon Nov 21 12:35:56 CET 2011
/var/opt/hosting/db/profiles/profiles/
Number of files: 22468
Number of files transferred: 22464
Total file size: 114.04G bytes
Total transferred file size: 114.04G bytes
Literal data: 243.47K bytes
Matched data: 114.04G bytes
File list size: 416.00K
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 74.45M
Total bytes received: 116.52M
sent 74.45M bytes received 116.52M bytes 185.68K bytes/sec
total size is 114.04G speedup is 597.17
Mon Nov 21 12:53:04 CET 2011
=========================================
And duration for rsync -rc for all tablespaces is 32 minutes 2 seconds :
Duration for only this tablespace is 21 minutes 41 seconds.
========================================
Mon Nov 21 15:07:57 CET 2011
/var/opt/hosting/db/profiles/profiles/
Number of files: 22468
Number of files transferred: 11
Total file size: 114.04G bytes
Total transferred file size: 50.75M bytes
Literal data: 308.81K bytes
Matched data: 50.44M bytes
File list size: 775.13K
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 1.12M
Total bytes received: 55.08K
sent 1.12M bytes received 55.08K bytes 899.32 bytes/sec
total size is 114.04G speedup is 97434.05
Mon Nov 21 15:29:38 CET 2011
========================================
So, it looks that option --ignore-times is helpful.
Thanks for your comments.
Jal
From | Date | Subject | |
---|---|---|---|
Next Message | Rudolf van der Leeden | 2011-11-21 18:02:12 | Re: Upgrading DBs with type=citext from 9.0.5 to 9.1.1 using pg_upgrade and create extension |
Previous Message | Tom Lane | 2011-11-21 16:27:46 | Re: Upgrading DBs with type=citext from 9.0.5 to 9.1.1 using pg_upgrade and create extension |