pattern classifiers; interval estimation
The present paper presents and discusses a methodology for interpreting the results, obtained from the application of a pattern classifier to an independent test set. It addresses the problem of testing the random classification null hypothesis in the multiclass case, by introducing an exact probability technique. The discussion of this technique includes the presentation of an interval estimation technique for the probability of correct classification, which is slightly more accurate than the ones described in some statistics textbooks.
 Blalock H. M.: Social Statistics. International Student Edition, 1979
 Montgomery D. C., Runger G. C.: Applied Statistics and Probability for Engineers
. Wiley, New York 1994 Zbl 1102.62134
 Nyssen E.: Evaluation of pattern classifiers – testing the significance of classification efficiency using an exact probability technique
. Pattern Recognition Lett. 17 (1996), 11, 1125–1129 DOI 10.1016/0167-8655(96)00070-0
 Siegel S.: Nonparametric Statistics for the Behavioural Sciences. McGraw Hill, New York 1956