Re: postgres streaming replication for HA

From: Samed YILDIRIM <samed(at)reddoc(dot)net>
To: Sunil N Shinde <sunil(dot)shinde(at)mastek(dot)com>, "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org>
Subject: Re: postgres streaming replication for HA
Date: 2017-09-08 10:54:54
Message-ID: 106341504868094@web42j.yandex.ru
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

<div>Hi Shinde,</div><div> </div><div>Could you please share recovery.conf file?</div><div> </div><div>Logs means that xlog file (000000030000000000000013) which is required by your standby has been removed before streamed to standby. To avoid this kind of situations you can use replication slot or you should set wal_keep_segment high enough.</div><div> </div><div>Best regards.</div><div>Samed YILDIRIM</div><div> </div><div> </div><div> </div><div>08.09.2017, 11:40, "Sunil N Shinde" &lt;sunil(dot)shinde(at)mastek(dot)com&gt;:</div><blockquote type="cite"><div link="blue" vlink="purple" lang="EN-IN"><div><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">Hi Samed,</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">Please find below the log  details also :</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="font-family:calibri,sans-serif;font-size:11pt;">cp: cannot stat ‘/var/lib/pgsql/9.6/data/archive/<span>000000030000000000000013</span>’: No such file or directory</span></p><p><span style="font-family:calibri,sans-serif;font-size:11pt;">&lt; <span>2017-09-08 08</span>:36:25.852 UTC &gt; LOG:  started streaming WAL from primary at 0/<span>13000000</span> on timeline 3</span></p><p><span style="font-family:calibri,sans-serif;font-size:11pt;">&lt; <span>2017-09-08 08</span>:36:25.852 UTC &gt; FATAL:  could not receive data from WAL stream: ERROR:  requested starting point 0/<span>13000000</span> is ahead of the WAL flush position of this server 0/1102FFF0</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><div><p><span style="color:#004080;font-family:calibri,sans-serif;font-size:10pt;">Thanks &amp; Regards,</span><span style="color:#1f497d;"> </span><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Sunil N Shinde</span></strong><span style="color:#1f497d;"> </span><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Assistant Manager – DBA</span></strong><span style="color:#1f497d;"> </span><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Mastek Ltd | Mastek Millennium Center, Millennium Business Park, Mahape, Navi Mumbai-400710 .</span></strong><span style="color:#1f497d;"> </span><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Mob:- <span>9819002393</span></span></strong></p></div><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><div><div style="border:none;border-top:solid #E1E1E1 1pt;padding:3pt 0cm 0cm 0cm;"><p><strong><span lang="EN-US" style="font-family:calibri,sans-serif;font-size:11pt;">From:</span></strong><span lang="EN-US" style="font-family:calibri,sans-serif;font-size:11pt;"> <a href="mailto:pgsql-admin-owner(at)postgresql(dot)org">pgsql-admin-owner(at)postgresql(dot)org</a> [mailto:<a href="mailto:pgsql-admin-owner(at)postgresql(dot)org">pgsql-admin-owner(at)postgresql(dot)org</a>] <strong>On Behalf Of </strong>Sunil N Shinde<br /><strong>Sent:</strong> 08 September 2017 12:38<br /><strong>To:</strong> Samed YILDIRIM &lt;<a href="mailto:samed(at)reddoc(dot)net">samed(at)reddoc(dot)net</a>&gt;; <a href="mailto:pgsql-admin(at)postgresql(dot)org">pgsql-admin(at)postgresql(dot)org</a><br /><strong>Subject:</strong> Re: [ADMIN] postgres streaming replication for HA</span></p></div></div><p> </p><table style="width:100%;" cellspacing="0" cellpadding="0" align="left" width="100%" border="0"><tbody><tr><td style="background:#910A19;padding:5.25pt 1.5pt 5.25pt 1.5pt;"> </td><td style="width:100%;background:#FDF2F4;padding:5.25pt 3.75pt 5.25pt 11.25pt;" width="100%"><div><p><span style="color:#212121;font-family:segoe ui,sans-serif;font-size:9pt;">This sender failed our fraud detection checks and may not be who they appear to be. Learn about <a href="http://aka.ms/LearnAboutSpoofing">spoofing</a></span></p></div></td><td style="width:56.25pt;background:#FDF2F4;padding:5.25pt 3.75pt 5.25pt 3.75pt;" width="60"><p><span style="color:#212121;font-family:segoe ui,sans-serif;font-size:9pt;"><a href="http://aka.ms/SafetyTipsFeedback">Feedback</a></span></p></td></tr></tbody></table><div><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">Hi Samed,</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">Thanks for the quick reply.</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">I am trying it manually with below step:</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"><span>1.<span style="font:7pt &quot;Times New Roman&quot;;">       </span></span></span><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">Shut down the primary node</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"><span>2.<span style="font:7pt &quot;Times New Roman&quot;;">       </span></span></span><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">Creating trigger file on standby node before  promoting it to primay.</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"><span>3.<span style="font:7pt &quot;Times New Roman&quot;;">       </span></span></span><span style="background:white;color:#222222;font-family:trebuchet ms,sans-serif;font-size:10.5pt;">"recovery_target_timline='latest'”  adding this parameter in recovery file on standby and restarting it.</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">On current standby :</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">psql -p 5432 -c "select pg_is_in_recovery();"</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">pg_is_in_recovery</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">-------------------</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">t</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">(1 row)</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">But on Current Primary:</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">psql -c "select application_name, state, sync_priority, sync_state from pg_stat_replication;"</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">application_name | state | sync_priority | sync_state</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">------------------+-------+---------------+------------</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;">(0 rows)</span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><span style="color:#004080;font-family:calibri,sans-serif;font-size:10pt;">Thanks &amp; Regards,</span><span style="color:#1f497d;"> </span><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Sunil N Shinde</span></strong><span style="color:#1f497d;"> </span></p><p><span style="color:#1f497d;font-family:calibri,sans-serif;font-size:11pt;"> </span></p><p><strong><span lang="EN-US" style="font-family:calibri,sans-serif;font-size:11pt;">From:</span></strong><span lang="EN-US" style="font-family:calibri,sans-serif;font-size:11pt;"> Samed YILDIRIM [<a href="mailto:samed(at)reddoc(dot)net">mailto:samed(at)reddoc(dot)net</a>]<br /><strong>Sent:</strong> 08 September 2017 12:22<br /><strong>To:</strong> <a href="mailto:pgsql-admin(at)postgresql(dot)org">pgsql-admin(at)postgresql(dot)org</a>; Sunil N Shinde &lt;<a href="mailto:Sunil(dot)Shinde(at)mastek(dot)com">Sunil(dot)Shinde(at)mastek(dot)com</a>&gt;<br /><strong>Subject:</strong> Re: [ADMIN] postgres streaming replication for HA</span></p><p> </p><p>Hi Shinde,</p><div><p> </p></div><div><p>Do you trying swithover manually? Or do you use any manager or script to handle switchover operation?</p></div><div><p> </p></div><div><p>Best regards.</p></div><div><p><br />--<br />Yandex.Mail mobil uygulamasından gönderildi<br /><br />08:51, 8 Eylül 2017, Sunil N Shinde &lt;<a href="mailto:sunil(dot)shinde(at)mastek(dot)com">sunil(dot)shinde(at)mastek(dot)com</a>&gt;:</p><blockquote style="margin-top:5pt;margin-bottom:5pt;"><p style="margin-bottom:12pt;"><br /><br /><br /> </p><div><p> </p><div><p> </p><p>Hi,</p><p> </p><p> </p><p> </p><p>I am forming 2 node cluster of streaming replication for HA. I could able to succeed with the replication process.</p><p> </p><p>But I am not able to complete the “<strong>switchover</strong>”.</p><p> </p><p> </p><p> </p><p>Version : postgresql-9.6</p><p> </p><p>OS :RHEL7</p><p> </p><p> </p><p> </p><p>Master Node Parameters:</p><p> </p><p>                                                <em><span style="font-family:cambria,serif;font-size:9pt;">wal_level = hot_standby </span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                synchronous_commit = local</span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                archive_mode = on </span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                archive_command = 'cp %p /var/lib/pgsql/9.6/data/archive/%f'                   </span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                max_wal_senders = 2</span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                wal_keep_segments = 10</span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                synchronous_standby_names = 'UWPGRECLUS2'</span></em></p><p> </p><p> </p><p> </p><p>                                pb_hba.conf     </p><p> </p><p style="margin-left:54pt;"><em><span style="font-family:cambria,serif;font-size:9pt;"># Localhost</span></em></p><p> </p><p style="margin-left:72pt;"><em><span style="font-family:cambria,serif;font-size:9pt;">host    replication     replica          127.0.0.1/32            md5          </span></em></p><p> </p><p style="margin-left:72pt;"><em><span style="font-family:cambria,serif;font-size:9pt;"># PostgreSQL Master IP address</span></em></p><p> </p><p style="margin-left:72pt;"><em><span style="font-family:cambria,serif;font-size:9pt;">host    replication     replica          10.0.3.4/32            md5</span></em></p><p> </p><p style="margin-left:72pt;"><em><span style="font-family:cambria,serif;font-size:9pt;"># PostgreSQL SLave IP address</span></em></p><p> </p><p style="margin-left:72pt;"><em><span style="font-family:cambria,serif;font-size:9pt;">host    replication     replica          10.0.3.5/32            md5</span></em></p><p> </p><p> </p><p> </p><p>Slave Node Parameters:</p><p> </p><p>                                                <em><span style="font-family:cambria,serif;font-size:9pt;">wal_level = hot_standby </span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                synchronous_commit = local</span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                max_wal_senders = 2</span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                wal_keep_segments = 10</span></em></p><p> </p><p><em><span style="font-family:cambria,serif;font-size:9pt;">                                                synchronous_standby_names = 'UWPGRECLUS2'</span></em></p><p> </p><p>                                                <em><span style="font-family:cambria,serif;font-size:9pt;">hot_standby = on</span></em></p><p> </p><p> </p><p> </p><p> </p><p><strong>Replication is properly happening from master to slave. But I am not able to switchover between the nodes.</strong></p><p> </p><p> </p><p> </p><p>Can anyone please guide me in this regard?</p><p> </p><p> </p><p> </p><p> </p><p> </p><p><span style="color:#004080;font-size:10pt;">Thanks &amp; Regards,</span><br /><br /><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Sunil N Shinde</span></strong><br /><br /><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Assistant Manager – DBA</span></strong><br /><br /><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Mastek Ltd | Mastek Millennium Center, Millennium Business Park, Mahape, Navi Mumbai-400710 .</span></strong><br /><br /><br /><strong><span style="color:#004080;font-family:trebuchet ms,sans-serif;font-size:10pt;">Mob:- <span>9819002393</span></span></strong></p><p> </p><p> </p><p> </p></div><p> </p></div><p style="margin-bottom:12pt;"> </p></blockquote></div></div></div></div></blockquote>

Attachment Content-Type Size
unknown_filename text/html 14.5 KB

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Sunil N Shinde 2017-09-08 11:11:14 Re: postgres streaming replication for HA
Previous Message Sunil N Shinde 2017-09-08 08:38:23 Re: postgres streaming replication for HA