Re: Throttling Streamming Replication

From: Cliff de Carteret <cliffdecarteret(at)googlemail(dot)com>
To: Magnus Hagander <magnus(at)hagander(dot)net>
Cc: Rodrigo Pereira da Silva <rodrigo(at)paripassu(dot)com(dot)br>, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: Throttling Streamming Replication
Date: 2013-01-25 14:18:51
Message-ID: CAC+bnxkxeM_e8Mp7Th=fawdj6g67d+x6nnC592YTvzSbSG_VEg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Can you not change your method of streaming replication. What is your
archive command, are you using rsync as you can control the bandwidth limit?

We use: archive_command = 'test ! -f
/opt/postgres/remote_pgsql/wal_archive/%f && rsync -az %p
/opt/postgres/remote_pgsql/wal_archive/%f'

According to the link below you can add --bwlimit=1000 to the rsync
arguments

http://scratching.psybermonkey.net/2009/03/rsync-transfer-rate-limit-aka-it-down.html

On 25 January 2013 12:59, Magnus Hagander <magnus(at)hagander(dot)net> wrote:

> On Fri, Jan 25, 2013 at 1:59 PM, Rodrigo Pereira da Silva
> <rodrigo(at)paripassu(dot)com(dot)br> wrote:
> > Hi Guys,
> >
> > We are having a problem with our infrastructure provider because the
> network
> > traffic between master and slave server is reaching more than 30k
> packages
> > per second(SLA says 20k/second).
> > Is there any way to throttle the streamming replication? I meant, any
> > parameter that I set the max number of megabytes sent to standby server
> per
> > second?
> > I didn't have any luck looking at the postgresql streamming replication
> > documentation. There is the wal_sender_delay, but I suppose that if I set
> > more than 1 second, it could accumulate a bunch of wal files and send it
> at
> > once. So, it wouldn't work.
>
> No, there is no such parameter. You might be able to send it through
> some proxy that slows it down, but there is no builtin support to do
> that.
>
> --
> Magnus Hagander
> Me: http://www.hagander.net/
> Work: http://www.redpill-linpro.com/
>
>
> --
> Sent via pgsql-general mailing list (pgsql-general(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general
>

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2013-01-25 14:42:27 Re: Prevent out of memory errors by reducing work_mem?
Previous Message Craig Ringer 2013-01-25 13:49:42 Re: Postgresql error