Advanced Methods for Pattern Recognition with the Reject Option
Source:DIEE, Cagliari (Italy), p.84 (2002)
Keywords:rej00; mcs00; mcs01
So far few works in the literature addressed the problem of designing effective classification rules with the reject option in real applications, and none of them attempted to give a theoretical support to such rules, taking into account the non-optimality of Chow's rule. A case of particular interest is the SVM classifier: despite its strong theoretical roots in statistical learning theory and its effectiveness in several real applications, no work addressed so far the issue of implementing a reject option in SVMs in a principled way.
In this thesis we address the two topics mentioned above. As a first contribution, we analyse the effects of estimation errors on the performance of Chow's rule and propose a new rejection rule based on using a different rejection threshold for each class, formally proving that it can allow to achieve a better error-reject trade-off than Chow's rule in presence of estimation errors on the a posteriori probabilities. We also analyse the improvement of the error-reject trade-off which can be attained by ensebles of linearly combined classifiers, by extending an analytical model derived in works by Tumer and Ghosh. As the second contribution we propose a method for implementing a reject option in SVM classifiers. Our method is based on a modification of the objective function of the SVM learning algorithm which allows to include the reject option in the resulting decision function, with the aim of preserving the capacity control capability of the original SVM learning algorithm.