Re: Improving tracking/processing of buildfarm test failures

Hello hackers,

Please take a look at the March report on buildfarm failures:
# SELECT br, count(*) FROM failures WHERE dt >= '2025-03-01' AND
 dt < '2025-04-01' GROUP BY br;
REL_13_STABLE: 5
REL_14_STABLE: 10
REL_15_STABLE: 7
REL_16_STABLE: 5
REL_17_STABLE: 12
master: 204
-- Total: 243
(Counting test failures only, excluding indent-check, Configure, Build
errors.)

# SELECT COUNT(*) FROM (SELECT DISTINCT issue_link FROM failures WHERE
 dt >= '2025-03-01' AND dt < '2025-04-01');
36

 # SELECT issue_link, count(*) FROM failures WHERE dt >= '2025-03-01' AND
 dt < '2025-04-01' GROUP BY issue_link ORDER BY 2 DESC LIMIT 6;
https://www.postgresql.org/message-id/1322262.1741643606%40sss.pgh.pa.us : 27
-- Fixed

https://www.postgresql.org/message-id/CAH2-WznHJZKUGL5T96TOcqxYHGXg8MnBwrYSs%2Bj4-PBoRRtWEw%40mail.gmail.com : 23
-- Fixed

https://www.postgresql.org/message-id/657815a2-5a89-fcc1-1c9d-d77a6986bc26@gmail.com : 23

https://www.postgresql.org/message-id/ggflhkciwdyotpoie323chu2c2idpjk5qimrn462encwx2io7s%40thmcxl7i6dpw : 21
-- Fixed

https://www.postgresql.org/message-id/CAD21AoBM6vAcPGR-ng0nqGG0yemR_ufdg3%2Bv3gkPa6Nc2ntnrA%40mail.gmail.com : 10
-- Fixed

https://www.postgresql.org/message-id/m2gyjjk6hazud7hezz25t7aw7rjv73fthkct4jqbvrnu3ezqz3%40nx3m53r7scce : 10
-- Fixed

SELECT count(*) FROM failures WHERE dt >= '2025-03-01' AND
 dt < '2025-04-01' AND issue_link IS NULL; -- Unsorted/unhelpful failures
38

Short-lived failures: 141

Best regards,
Alexander Lakhin
Neon (https://neon.tech)