Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04

On 15/12/2016 17:07, Sébastien Beausoleil wrote:
> Hi,
> I have a big problem with one of my Postgresql server.
> I started a standard package update and during the Postgresql update, something happen that it make it fails. Since when, postgresql isn't able to start.
> In the log, here is what it is showed:
What postgresql update ?
>
> 2016-12-15 08:40:03 EST FATAL: "/var/lib/postgresql/9.3/main" is not a valid data directory
> 2016-12-15 08:40:03 EST DETAIL: File "/var/lib/postgresql/9.3/main/PG_VERSION" is missing.
>
> And if I go further, there is a reccuring message:
>
> 2016-12-14 22:01:14 EST FATAL: could not open relation mapping file "global/pg_filenode.map": No such file or directory
> 2016-12-14 22:01:15 EST ERROR: could not open file "base/305852/11848": No such file or directory
> 2016-12-14 22:01:15 EST CONTEXT: writing block 0 of relation base/305852/11848
> 2016-12-14 22:01:15 EST WARNING: could not write block 0 of base/305852/11848
> 2016-12-14 22:01:15 EST DETAIL: Multiple failures --- write error might be permanent.
>
>
> I notice, when comparing with a similare server, that 3 db data in the main/base folder are empty, I suppose it's the postgres, template0 et template1 database.
That's pretty bad. Can you locate them anywhere else in your file system?
>
> I try pg_resetxlog on a copy of the data dir, the server came up but the "postgres" user isn't a valide role...
>
> I had a cron which make dump backup each day but there was un bug in the script that make it right, so I know we should not rely on recovery, but by now, It s really my only hope.
Do you take any file system backup by pg_start_backup/pg_stop_backup ? or pg_basebackup? or WAL archiving?
>
> Could someone help me?
>
> Sebastien
>
>
> OS: Ubuntu Server 14.04 64bit
> Postgresql: 9.3
>
>
>
>
>

--
Achilleas Mantzios
IT DEV Lead
IT DEPT
Dynacom Tankers Mgmt