BUG #16680: Crash database with sefault 11

From: PG Bug reporting form <noreply(at)postgresql(dot)org>
To: pgsql-bugs(at)lists(dot)postgresql(dot)org
Cc: zhitelev(dot)ivan(at)gmail(dot)com
Subject: BUG #16680: Crash database with sefault 11
Date: 2020-10-21 10:00:36
Message-ID: 16680-ffe81c53d7013bfe@postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

The following bug has been logged on the website:

Bug reference: 16680
Logged by: Иван Жителев
Email address: zhitelev(dot)ivan(at)gmail(dot)com
PostgreSQL version: 10.5
Operating system: Debian stretch 9.11. Core version: 4.9.0-11-amd64
Description:

Hello! Faced a problem regular server crashes.
There is no dependence on specific SQL queries.
Initially, the PG logs informed us about the crash on commits, as well as
other requests. It was not possible to identify patterns. Then we installed
autocommit on our application. Now there is no crash on commit, but it
happens on other random (as it seems to us) requests.
Server crashes are on average 10 times per day.
Also, crashes occur with the same symptoms on a server running PG 12.1.
The backtrace in the core dump is always repeated.
The volume of the database is 700 GB.
Attached are logs, backtrace and system information below.
Resource:
Virtual machine, not clouds.
OS: Debian stretch 9.11. Core version: 4.9.0-11-amd64
Memory 64 Gb;
CPU: 12 core, Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
HDD storage.

Not default config PG:
application_name = psql
archive_command = /bin/gzip --force < %p >
/opt/postgres/backup/archivelogs/%f.gz
archive_mode = on
autovacuum_analyze_scale_factor = 0.05
autovacuum_max_workers = 8
autovacuum_vacuum_scale_factor = 0.01
checkpoint_completion_target = 0.9
config_file = /opt/postgres/data/postgresql.conf
cron.database_name = postgres
cron.log_statement = off
data_checksums = on
data_directory = /opt/postgres/data
DateStyle = ISO, DMY
default_statistics_target = 100
default_text_search_config = pg_catalog.russian
dynamic_shared_memory_type = posix
effective_cache_size = 6291456 8kB
hba_file = /opt/postgres/data/pg_hba.conf
ident_file = /opt/postgres/data/pg_ident.conf
idle_in_transaction_session_timeout = 3600000 ms
lc_collate = ru_RU.UTF8
lc_ctype = ru_RU.UTF8
lc_messages = C.UTF-8
lc_monetary = ru_RU.UTF8
lc_numeric = ru_RU.UTF8
lc_time = ru_RU.UTF8
listen_addresses = 0.0.0.0
log_destination = stderr
log_directory = log
log_error_verbosity = default
log_filename = postgresql.log
log_line_prefix = [%m %a %u %h]
log_min_duration_statement = 5000 ms
log_timezone = W-SU
logging_collector = on
maintenance_work_mem = 2097152 kB
max_connections = 300
max_parallel_workers = 8
max_parallel_workers_per_gather = 6
max_stack_depth = 2048 kB
max_wal_senders = 8
max_wal_size = 16384 MB
max_worker_processes = 12
min_wal_size = 1024 MB
port = 5432
search_path = "$user", public, topology
server_encoding = UTF8
session_preload_libraries = auto_explain
shared_buffers = 2097152 8kB
shared_preload_libraries = pg_stat_statements,pg_cron
stats_temp_directory = /opt/postgres/tmp
TimeZone = W-SU
transaction_deferrable = off
transaction_isolation = read committed
transaction_read_only = off
unix_socket_directories = /opt/postgres/run
wal_buffers = 2048 8kB
wal_keep_segments = 512
wal_level = replica
work_mem = 98304 kB

PG log:
[2020-10-21 09:07:33.589 MSK ] LOG: server process (PID 3229) was
terminated by signal 11: Segmentation fault
[2020-10-21 09:07:33.589 MSK ] DETAIL: Failed process was running: SELECT
* FROM rldd.get_exists_status('{"claim_id": "7f8fcb4d22e5c60001955a12",
"status_code": "10"}')
[2020-10-21 09:07:33.589 MSK ] LOG: terminating any other active server
processes
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.589 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.589 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.590 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.590 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.590 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.590 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.590 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.590 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.592 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.592 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.592 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.589 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.589 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.589 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.592 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.592 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.592 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.592 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.592 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.592 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.593 MSK app_user 10.134.126.23] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.593 MSK app_user 10.134.126.23] DETAIL: The postmaster
has commanded this server process to roll back the current transaction and
exit, because another server process exited abnormally and possibly
corrupted shared memory.
[2020-10-21 09:07:33.593 MSK app_user 10.134.126.23] HINT: In a moment you
should be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.593 MSK app_user 10.134.126.23] CONTEXT: PL/pgSQL
function tmp.sc_ds_import(text,text,text,text,jsonb) line 60 at assignment
PL/pgSQL function gs.job_procedure(jsonb) line 301 at assignment
SQL statement "select gs.job_procedure($1)"
PL/pgSQL function queues_call(bigint) line 40 at EXECUTE
[2020-10-21 09:07:33.597 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.597 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.597 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.597 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.597 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.597 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.599 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.599 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.599 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.599 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.599 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.599 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.599 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.599 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.599 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.599 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.599 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.599 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.599 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.599 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.599 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.599 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.599 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.599 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.601 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.601 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.601 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.601 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.601 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.601 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.601 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.601 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.601 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.602 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.602 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.602 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.602 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.602 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.602 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.602 MSK ] WARNING: terminating connection because of
crash of another server process
[2020-10-21 09:07:33.602 MSK ] DETAIL: The postmaster has commanded this
server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.602 MSK ] HINT: In a moment you should be able to
reconnect to the database and repeat your command.
[2020-10-21 09:07:33.602 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.602 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.602 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.606 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.606 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.606 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.607 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.607 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.607 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.609 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.609 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.609 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.610 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.610 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.610 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.611 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.611 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.611 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.612 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.612 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.612 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.612 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.612 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.612 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.613 MSK app_user 10.134.126.23] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.613 MSK app_user 10.134.126.23] DETAIL: The postmaster
has commanded this server process to roll back the current transaction and
exit, because another server process exited abnormally and possibly
corrupted shared memory.
[2020-10-21 09:07:33.613 MSK app_user 10.134.126.23] HINT: In a moment you
should be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.613 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.613 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.613 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.613 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.613 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.613 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.614 MSK ] WARNING: terminating connection because of
crash of another server process
[2020-10-21 09:07:33.614 MSK ] DETAIL: The postmaster has commanded this
server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.614 MSK ] HINT: In a moment you should be able to
reconnect to the database and repeat your command.
[2020-10-21 09:07:33.614 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.614 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.614 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.614 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.614 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.614 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.616 MSK ] LOG: archiver process (PID 27368) exited
with exit code 1
[2020-10-21 09:07:33.621 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.621 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.621 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.623 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.623 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.623 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.623 MSK app_user [local]] WARNING: terminating
connection because of crash of another server process
[2020-10-21 09:07:33.623 MSK app_user [local]] DETAIL: The postmaster has
commanded this server process to roll back the current transaction and exit,
because another server process exited abnormally and possibly corrupted
shared memory.
[2020-10-21 09:07:33.623 MSK app_user [local]] HINT: In a moment you should
be able to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.624 MSK app_user] WARNING: terminating connection
because of crash of another server process
[2020-10-21 09:07:33.624 MSK app_user] DETAIL: The postmaster has commanded
this server process to roll back the current transaction and exit, because
another server process exited abnormally and possibly corrupted shared
memory.
[2020-10-21 09:07:33.624 MSK app_user] HINT: In a moment you should be able
to reconnect to the database and repeat your command.
[2020-10-21 09:07:33.645 MSK [unknown] app_user 10.134.126.23] FATAL: the
database system is in recovery mode
[2020-10-21 09:07:33.659 MSK [unknown] app_user] FATAL: the database system
is in recovery mode
[2020-10-21 09:07:33.660 MSK [unknown] app_user] FATAL: the database system
is in recovery mode
[2020-10-21 09:07:33.671 MSK [unknown] app_user 10.134.126.23] FATAL: the
database system is in recovery mode
[2020-10-21 09:07:33.673 MSK ] LOG: all server processes terminated;
reinitializing
[2020-10-21 09:07:33.777 MSK [unknown] app_user] FATAL: the database system
is in recovery mode
[2020-10-21 09:07:33.777 MSK ] LOG: database system was interrupted; last
known up at 2020-10-21 09:03:12 MSK
[2020-10-21 09:07:33.870 MSK ] LOG: database system was not properly shut
down; automatic recovery in progress
[2020-10-21 09:07:33.895 MSK ] LOG: redo starts at 1705/3E86DAE8
[2020-10-21 09:07:33.912 MSK ] LOG: received SIGHUP, reloading
configuration files
[2020-10-21 09:07:34.248 MSK [unknown] app_user] FATAL: the database system
is in recovery mode
[2020-10-21 09:07:34.333 MSK ] LOG: redo done at 1705/4069DFC0
[2020-10-21 09:07:34.333 MSK ] LOG: last completed transaction was at log
time 2020-10-21 09:07:33.50992+03
[2020-10-21 09:07:34.341 MSK [unknown] app_user] FATAL: the database system
is in recovery mode
[2020-10-21 09:07:34.483 MSK ] LOG: database system is ready to accept
connections

GDB backtrace:
Reading symbols from /opt/postgres/bin/postgres...(no debugging symbols
found)...done.
[New LWP 20654]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `postgres: apipy pgapp 10.10.24.20(370'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00007fb9b5d7a303 in epoll_wait () at
../sysdeps/unix/syscall-template.S:84
84 ../sysdeps/unix/syscall-template.S: No such file or directory.
(gdb) bt
#0 0x00007fb9b5d7a303 in epoll_wait () at
../sysdeps/unix/syscall-template.S:84
#1 0x000056501737c618 in WaitEventSetWait ()
#2 0x00005650172a6687 in secure_read ()
#3 0x00005650172b0310 in ?? ()
#4 0x00005650172b1155 in pq_getbyte ()
#5 0x000056501739d537 in PostgresMain ()
#6 0x00005650170fc9b5 in ?? ()
#7 0x0000565017333d1c in PostmasterMain ()
#8 0x00005650170fdda1 in main ()

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message Tom Lane 2020-10-21 14:21:27 Re: BUG #16680: Crash database with sefault 11
Previous Message Tom Lane 2020-10-21 02:41:30 Re: Incorrect rounding of double values at max precision