Re: missing chunk 0 for toast value ...

On Tue, Oct 25, 2011 at 4:11 PM, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:

> Andrew Hammond <andrew(dot)george(dot)hammond(at)gmail(dot)com> writes:
> > The following occur in the log file immediately before the
> > error message above.
>
> Hmm, that's pretty interesting ... are there any nearby autovacuums of
> pg_toast_2619?
>

Several, both before and after the error message:

Oct 24 03:49:57 db-app02 postgres[23554]: [4-1] user=,db= LOG: automatic
vacuum of table "admin_production.pg_toast.pg_toast_2619": index scans: 1
Oct 24 03:49:57 db-app02 postgres[23554]: [4-2] #011pages: 0 removed, 206
remain
Oct 24 03:49:57 db-app02 postgres[23554]: [4-3] #011tuples: 220 removed, 608
remain
Oct 24 03:49:57 db-app02 postgres[23554]: [4-4] #011system usage: CPU
0.00s/0.00u sec elapsed 0.10 sec

Oct 24 03:53:57 db-app02 postgres[23800]: [5-1] user=,db= LOG: automatic
vacuum of table "admin_production.pg_toast.pg_toast_2619": index scans: 1
Oct 24 03:53:57 db-app02 postgres[23800]: [5-2] #011pages: 0 removed, 206
remain
Oct 24 03:53:57 db-app02 postgres[23800]: [5-3] #011tuples: 220 removed, 608
remain
Oct 24 03:53:57 db-app02 postgres[23800]: [5-4] #011system usage: CPU
0.01s/0.00u sec elapsed 0.12 sec

Oct 24 03:57:57 db-app02 postgres[24059]: [4-1] user=,db= LOG: automatic
vacuum of table "admin_production.pg_toast.pg_toast_2619": index scans: 1
Oct 24 03:57:57 db-app02 postgres[24059]: [4-2] #011pages: 0 removed, 206
remain
Oct 24 03:57:57 db-app02 postgres[24059]: [4-3] #011tuples: 220 removed, 608
remain
Oct 24 03:57:57 db-app02 postgres[24059]: [4-4] #011system usage: CPU
0.00s/0.00u sec elapsed 0.04 sec

Oct 24 04:01:57 db-app02 postgres[24394]: [4-1] user=,db= LOG: automatic
vacuum of table "admin_production.pg_toast.pg_toast_2619": index scans: 1
Oct 24 04:01:57 db-app02 postgres[24394]: [4-2] #011pages: 0 removed, 206
remain
Oct 24 04:01:57 db-app02 postgres[24394]: [4-3] #011tuples: 220 removed, 608
remain
Oct 24 04:01:57 db-app02 postgres[24394]: [4-4] #011system usage: CPU
0.00s/0.01u sec elapsed 0.04 sec

Oct 24 04:05:57 db-app02 postgres[24640]: [2-1]
user=nutricate,db=admin_production ERROR: missing chunk number 0 for toast
value 2411466 in pg_toast_2619

Oct 24 04:05:57 db-app02 postgres[24639]: [6-1] user=,db= LOG: automatic
vacuum of table "admin_production.pg_toast.pg_toast_2619": index scans: 1
Oct 24 04:05:57 db-app02 postgres[24639]: [6-2] #011pages: 0 removed, 206
remain
Oct 24 04:05:57 db-app02 postgres[24639]: [6-3] #011tuples: 216 removed, 608
remain
Oct 24 04:05:57 db-app02 postgres[24639]: [6-4] #011system usage: CPU
0.00s/0.00u sec elapsed 0.08 sec

Oct 24 04:09:57 db-app02 postgres[24877]: [5-1] user=,db= LOG: automatic
vacuum of table "admin_production.pg_toast.pg_toast_2619": index scans: 1
Oct 24 04:09:57 db-app02 postgres[24877]: [5-2] #011pages: 0 removed, 206
remain
Oct 24 04:09:57 db-app02 postgres[24877]: [5-3] #011tuples: 220 removed, 608
remain
Oct 24 04:09:57 db-app02 postgres[24877]: [5-4] #011system usage: CPU
0.00s/0.00u sec elapsed 0.10 sec

Oct 24 04:13:57 db-app02 postgres[25116]: [6-1] user=,db= LOG: automatic
vacuum of table "admin_production.pg_toast.pg_toast_2619": index scans: 1
Oct 24 04:13:57 db-app02 postgres[25116]: [6-2] #011pages: 0 removed, 206
remain
Oct 24 04:13:57 db-app02 postgres[25116]: [6-3] #011tuples: 220 removed, 608
remain
Oct 24 04:13:57 db-app02 postgres[25116]: [6-4] #011system usage: CPU
0.00s/0.00u sec elapsed 0.12 sec