Re: Buildfarm feature request: some way to track/classify failures

I don't know if this has come up yet but....

In terms of tagging errors we might be able to use some machine
learning techniques.

There are NLP/learning systems that interpret logs. They learn over
time what is normal and what isn't and can flag things that are
abnormal.

For example, people are using support vector machines (SVM) analysis
on log files to do intrusion detection. Here's a link for intrusion
detection called Robust Anomaly Detection Using Support Vector
Machines http://wwwcsif.cs.ucdavis.edu/~liaoy/research/
RSVM_Anomaly_journal.pdf

This paper from IBM gives some more background information on how
such a thing might work. http://www.research.ibm.com/journal/sj/413/
johnson.html

I have previously used an open source toolkit from CMU called rainbow
to do these types of analysis.

-arturo