Fast Algorithm and Implementation of Dissimilarity Self-Organizing Maps

Brieuc Conan-Guez (1) , Fabrice Rossi (2) , Aïcha El Golli (2)

1 LITA - Laboratoire d'Informatique Théorique et Appliquée
2 AxIS - Usage-centered design, analysis and improvement of information systems

In many real world applications, data cannot be accurately represented by vectors. In those situations, one possible solution is to rely on dissimilarity measures that enable sensible comparison between observations. Kohonen's Self-Organizing Map (SOM) has been adapted to data described only through their dissimilarity matrix. This algorithm provides both non linear projection and clustering of non vector data. Unfortunately, the algorithm suffers from a high cost that makes it quite difficult to use with voluminous data sets. In this paper, we propose a new algorithm that provides an important reduction of the theoretical cost of the dissimilarity SOM without changing its outcome (the results are exactly the same as the ones obtained with the original algorithm). Moreover, we introduce implementation methods that result in very short running times. Improvements deduced from the theoretical cost model are validated on simulated and real world data (a word list clustering problem). We also demonstrate that the proposed implementation methods reduce by a factor up to 3 the running time of the fast algorithm over a standard implementation.

Mots clés: Fast implementation; Self Organizing Map; Clustering; Non linear projection; Unsupervised learning; Dissimilarity Data; Proximity Data; Pairwise Data

Domaines: Réseau de neurones [cs.NE]; Apprentissage [cs.LG]

Brieuc Conan-Guez, Fabrice Rossi, Aïcha El Golli. Fast Algorithm and Implementation of Dissimilarity Self-Organizing Maps. Neural Networks, 2006, 19 (6-7), pp.855-863. ⟨10.1016/j.neunet.2006.05.002⟩. ⟨inria-00174196⟩