Re: Are indexes blown?

On 15/02/2008, Richard Huxton <dev(at)archonet(dot)com> wrote:
> Phoenix Kiula wrote:
> > On 15/02/2008, Richard Huxton <dev(at)archonet(dot)com> wrote:
> >>
>
> >> Are you sure the two sets of vmstat/top figures are from when PG was
> >> crashing/running queries slow? Everything seems idle to me in those figures.
> >
> > No. They are the vmstat figures from when I was replying to your
> > email. What will vmstat tell me and how should I set it up to do
> > "vmstat 10 logging"?
>
>
> I'd write a small script and call it e.g. "trackusage.sh" and save it in
> /tmp/
>
> #!/bin/sh
> while (/bin/true)
> do
> date >> /tmp/vmstat_figures.txt
> vmstat 10 60 >> /tmp/vmstat_figures.txt
> done
>
> Then, set the execute flag on it and do something like:
> nohup /tmp/trackusage.sh &
>

Thanks Richard!

The script you suggested doesn't work:

tmp > ./trackusage.sh
-bash: ./trackusage.sh: /bin/sh: bad interpreter: Permission denied

Anyway, I did the vmstat command. I was running it while the system
was ok, then not ok, then ok...and so on. So I hope these numbers have
captured what the issue is:

tmp > vmstat 10 60
procs -----------memory---------- ---swap-- -----io---- --system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 0 3380 331140 114344 2992304 0 0 31 34 20 73 2 1 93 3
0 0 3380 414412 114352 2992296 0 0 0 100 1105 286 1 1 96 2
0 0 3380 430356 114380 2992268 0 0 0 133 1103 280 1 1 95 3
0 0 3380 418988 114392 2992256 0 0 2 120 1098 277 1 2 93 4
0 0 3380 347996 114408 2992240 0 0 0 85 1081 134 1 0 97 2
0 0 3380 293236 114444 2992204 0 0 0 40 1076 138 0 0 97 2
0 0 3380 252860 114456 2992192 0 0 0 80 1086 141 0 0 97 2
0 0 3380 141340 114480 2992168 0 0 2 54 1078 145 1 0 97 2
0 0 3380 119940 114504 2992144 0 0 0 31 1079 143 1 1 97 1
0 0 3380 104252 114524 2992124 0 0 0 64 1087 182 1 1 96 2
0 0 3380 90556 114560 2992088 0 0 0 59 1087 144 1 0 97 2
0 0 3380 132476 115088 2995460 0 0 52 174 1130 447 2 1 92 4
0 1 3380 280628 115124 2995684 0 0 31 220 1144 479 4 2 91 4
0 0 3380 361340 115152 2995656 0 0 0 147 1135 338 2 1 94 3
0 0 3380 382028 115180 2995628 0 0 2 113 1109 253 1 1 96 2
0 0 3380 369740 115220 2995588 0 0 3 200 1107 260 1 1 93 4
0 0 3380 323140 115248 2995560 0 0 0 60 1097 153 1 0 97 2
0 0 3380 280260 115272 2995536 0 0 0 77 1087 133 1 0 98 1
0 0 3380 200580 115296 2995512 0 0 2 65 1089 140 1 0 97 2
0 0 3380 81916 115392 2995676 0 0 17 82 1089 188 2 1 94 2
0 0 3380 16980 98072 2974256 0 0 48 122 1102 190 2 1 95 3
1 0 3380 21588 73160 2954708 0 0 86 274 1128 276 2 2 88 8
0 0 3380 52692 57860 2932048 0 0 1 128 1106 211 2 1 95 3
0 0 3380 184748 57960 2931948 0 0 6 219 1128 451 2 1 92 5
0 0 3380 342996 58016 2931892 0 0 0 140 1122 465 2 1 94 3
0 0 3380 452020 58068 2932100 0 0 1 122 1114 268 1 1 95 2
0 0 3380 478044 58132 2932036 0 0 0 106 1099 294 1 1 95 3
0 0 3380 447540 58224 2931944 0 0 1 238 1098 319 2 2 91 5
0 0 3380 392524 58284 2931884 0 0 0 71 1078 134 0 1 97 2
0 0 3380 299684 58340 2931828 0 0 1 88 1079 150 1 0 97 2
0 0 3380 231652 58388 2931780 0 0 0 40 1076 135 1 1 97 1
0 0 3380 139012 58432 2931736 0 0 0 42 1076 145 1 0 97 2
0 0 3380 117884 58472 2931696 0 0 1 67 1092 151 1 0 96 2
0 0 3380 129460 58528 2931640 0 0 0 59 1097 190 1 1 96 2
0 0 3380 179892 58584 2931584 0 0 0 42 1100 158 1 1 97 2
0 0 3380 272900 58648 2931520 0 0 0 111 1114 308 1 1 95 3
0 0 3380 399100 58704 2931724 0 0 0 132 1128 352 1 1 95 2
0 0 3380 484556 58748 2931680 0 0 0 76 1111 269 1 1 96 2
0 0 3380 501180 58804 2931884 0 0 0 93 1103 249 1 1 96 2
0 0 3380 492636 58864 2931824 0 0 0 138 1094 259 1 1 95 3
1 1 3380 428380 58912 2932036 0 0 0 44 1088 142 1 0 98 1
0 0 3380 362340 58996 2931952 0 0 1 45 1085 138 1 0 97 2
0 0 3380 292708 59072 2931876 0 0 0 71 1082 138 1 1 97 2
0 0 3380 179292 59172 2931776 0 0 0 65 1089 149 1 0 97 2
0 0 3380 127292 59236 2931712 0 0 0 38 1090 149 1 0 97 1
0 0 3380 101940 59304 2931904 0 0 22 72 1097 186 1 1 96 2
0 0 3380 134068 59340 2931868 0 0 0 74 1100 148 1 0 97 1
0 1 3380 257908 59400 2932068 0 0 0 112 1114 424 2 1 95 3
0 1 3380 399484 59460 2932008 0 0 0 96 1127 336 1 1 96 2
1 0 3380 480548 59524 2932464 0 0 1 100 1118 286 1 1 96 2
1 0 3380 497092 59580 2932408 0 0 0 120 1110 282 1 1 96 3
0 1 3380 481684 59652 2932336 0 0 0 174 1099 310 2 2 92 4
0 0 3380 416772 59692 2932296 0 0 0 49 1085 136 1 0 97 2
0 0 3380 372108 59740 2932248 0 0 1 68 1089 144 1 0 97 2
1 1 3380 307676 59808 2932180 0 0 1 75 1083 140 1 0 97 2
0 0 3380 232620 59904 2932084 0 0 4 78 1077 154 1 0 97 2
procs -----------memory---------- ---swap-- -----io---- --system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 0 3380 169996 59948 2932300 0 0 0 41 1092 157 1 1 96 2
0 0 3380 171660 59996 2932252 0 0 0 135 1105 190 1 1 96 3
2 0 3380 166140 60052 2932456 0 0 0 47 1101 158 1 0 97 2
4 0 3380 269860 60104 2932404 0 0 0 103 1114 326 1 2 94 2

Please advise??