Streaming Replication error - relation uninitialized and WAL contains references to invalid pages

From: Gareth Lyons <Gareth(dot)Lyons(at)rws(dot)com>
To: "'pgsql-general(at)postgresql(dot)org'" <pgsql-general(at)postgresql(dot)org>
Subject: Streaming Replication error - relation uninitialized and WAL contains references to invalid pages
Date: 2012-11-27 13:38:04
Message-ID: FC095BB7F38015459A218ADC9120AF26010DB798C6@RWSEXDBCP.rws.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

PostgreSQL 9.2 on Windows Server 2008 R2 64-bit

Streaming Replication initialised & working on a 500GB database.
Following day on slave, following errors in the log:

2012-11-27 09:57:53 GMT WARNING: page 911726 of relation pg_tblspc/16570/PG_9.2_201204301/16571/16595 is uninitialized
2012-11-27 09:57:53 GMT CONTEXT: xlog redo vacuum: rel 16570/16571/16595; blk 911727, lastBlockVacuumed 911725
2012-11-27 09:57:53 GMT PANIC: WAL contains references to invalid pages
2012-11-27 09:57:53 GMT CONTEXT: xlog redo vacuum: rel 16570/16571/16595; blk 911727, lastBlockVacuumed 911725
2012-11-27 09:57:54 GMT LOG: startup process (PID 1392) exited with exit code 3
2012-11-27 09:57:54 GMT LOG: terminating any other active server processes

Restarting the PostgreSQL service on the slave, the log shows the same errors:

2012-11-27 10:26:39 GMT LOG: database system was interrupted while in recovery at log time 2012-11-27 09:37:29 GMT
2012-11-27 10:26:39 GMT HINT: If this has occurred more than once some data might be corrupted and you might need to choose an earlier recovery target.
2012-11-27 10:26:39 GMT LOG: entering standby mode
2012-11-27 10:26:39 GMT LOG: redo starts at 3A8/11A5A9A8
2012-11-27 10:26:40 GMT FATAL: the database system is starting up
2012-11-27 10:26:41 GMT FATAL: the database system is starting up
2012-11-27 10:26:42 GMT FATAL: the database system is starting up
2012-11-27 10:26:43 GMT FATAL: the database system is starting up
2012-11-27 10:26:44 GMT FATAL: the database system is starting up
2012-11-27 10:26:45 GMT FATAL: the database system is starting up
2012-11-27 10:26:46 GMT FATAL: the database system is starting up
2012-11-27 10:26:47 GMT FATAL: the database system is starting up
2012-11-27 10:26:48 GMT FATAL: the database system is starting up
2012-11-27 10:26:49 GMT FATAL: the database system is starting up
2012-11-27 10:26:50 GMT LOG: consistent recovery state reached at 3A8/387BFF48
2012-11-27 10:26:50 GMT LOG: database system is ready to accept read only connections
2012-11-27 10:26:50 GMT WARNING: page 911726 of relation pg_tblspc/16570/PG_9.2_201204301/16571/16595 is uninitialized
2012-11-27 10:26:50 GMT CONTEXT: xlog redo vacuum: rel 16570/16571/16595; blk 911727, lastBlockVacuumed 911725
2012-11-27 10:26:50 GMT PANIC: WAL contains references to invalid pages
2012-11-27 10:26:50 GMT CONTEXT: xlog redo vacuum: rel 16570/16571/16595; blk 911727, lastBlockVacuumed 911725
2012-11-27 10:26:50 GMT LOG: startup process (PID 2640) exited with exit code 3
2012-11-27 10:26:50 GMT LOG: terminating any other active server processes

I noticed a autovacuum process started on the master at 09:04am and was still running when the slave tripped over - could this be a factor?
Or could this be a consequence of the WAL corruption issue fixed in 9.2.1/9.1.6?

Full page writes is switched on.

Thanks
Gareth

________________________________

This email and any attachments are intended only for the use of the individual or entity to which it is directed and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If you have received this email and you are not the intended recipient or the employee or agent responsible for delivering this email to the intended recipient, please inform the RWS IT Service Desk on +44 1753 480700 and then delete the email from your system. If you are not a named addressee you must not use, disclose, disseminate, distribute, copy, print or reply to this email. Although RWS routinely screens for viruses, addressees should scan this email and any attachments for viruses. RWS makes no representation nor warranty as to the absence of viruses in this email or any attachments.
RWS Group Limited, Europa House, Chiltern Park, Chiltern Hill, Chalfont St Peter, Bucks, SL9 9FG, Registered number 1575193. Details for other group companies are at http://www.rws.com/lang_english/pdf/investors/Company%20information/Country_of_incorporation_and_operation.pdf

________________________________

WARNING: Our spam filters may occasionally eliminate legitimate e-mails from clients. If your e-mail contains important instructions, please ensure that we acknowledge receipt of those instructions.

Browse pgsql-general by date

  From Date Subject
Next Message Kevin Grittner 2012-11-27 14:59:39 Re: Restore postgres to specific time
Previous Message Guillaume Lelarge 2012-11-27 08:54:09 Re: Adding Default Privileges to a schema for a role