Optimal Brain Surgeon Variants for Feature Selection

Mohammed Attik (1) , Laurent Bougrain (1) , Frédéric Alexandre (1)

1 CORTEX - Neuromimetic intelligence

This paper presents three pruning algorithms based on Optimal Brain Surgeon (OBS) and Unit-Optimal Brain Surgeon (Unit-OBS). The first variant performs a backward selection by successively removing single weights from the input variables to the hidden units in a fully connected multilayer perceptron (MLP) for variable selection. The second one removes a subset of non-significant weights in one step. The last one combines the two properties presented above. Simulation results obtained on the Monk's problem illustrate the specificities of each method described in this paper according to the preserved variables and the preserved weights.

Mots clés: sélection de variables; feature selection; pruning; neural networks; élagage; réseaux de neurones; obs

Domaines: Autre [cs.OH]

Mohammed Attik, Laurent Bougrain, Frédéric Alexandre. Optimal Brain Surgeon Variants for Feature Selection. International Joint Conference on Neural Networks - IJCNN'04, 2004, Budapest, Hungary, 4 p. ⟨inria-00099923⟩