Combination of One-Class Support Vector Machines for Classification with Reject Option

Blaise Hanczar (1, 2) , Michèle Sebag (3, 2)

1 LIPADE - EA 2517 - Laboratoire d'Informatique Paris Descartes
2 TAO - Machine Learning and Optimisation
3 LRI - Laboratoire de Recherche en Informatique

This paper focuses on binary classification with reject op-tion, enabling the classifier to detect and abstain hazardous decisions. While reject classification produces in more reliable decisions, there is a tradeoff between accuracy and rejection rate. Two type of rejection are considered: ambiguity and outlier rejection. The state of the art mostly handles ambiguity rejection and ignored outlier rejection. The proposed approach, referred as CONSUM, handles both ambiguity and outliers detection. Our method is based on a quadratic constrained optimization formulation, combining one-class support vector machines. An adapta-tion of the sequential minimal optimization algorithm is proposed to solve the minimization problem. The experimental study on both artifi-cial and real world datasets exams the sensitivity of the CONSUM with respect to the hyper-parameters and demonstrates the superiority of our approach.

Mots clés: Support vector machines; Abstaining clas-sifier; Supervised classification; Rejection option

Domaines: Intelligence artificielle [cs.AI]

Blaise Hanczar, Michèle Sebag. Combination of One-Class Support Vector Machines for Classification with Reject Option. Machine Learning and Knowledge Discovery in Databases - Part I, Sep 2014, Nancy, France. pp.547 - 562, ⟨10.1007/978-3-662-44848-9_35⟩. ⟨hal-01109774⟩