Data Streaming with Affinity Propagation

Xiangliang Zhang (1) , Cyril Furtlehner (1) , Michèle Sebag (1)

1 TAO - Machine Learning and Optimisation

This paper proposed StrAP (Streaming AP), extending Affinity Propagation (AP) to data steaming. AP, a new clustering algorithm, extracts the data items, or exemplars, that best represent the dataset using a message passing method. Several steps are made to build StrAP. The first one (Weighted AP) extends AP to weighted items with no loss of generality. The second one (Hierarchical WAP) is concerned with reducing the quadratic AP complexity, by applying AP on data subsets and further applying Weighted AP on the exemplars extracted from all subsets. Finally StrAP extends Hierarchical WAP to deal with changes in the data distribution. Experiments on artificial datasets, on the Intrusion Detection benchmark (KDD99) and on a real-world problem, clustering the stream of jobs submitted to the EGEE grid system, provide a comparative validation of the approach.

Domaines: Intelligence artificielle [cs.AI]

Xiangliang Zhang, Cyril Furtlehner, Michèle Sebag. Data Streaming with Affinity Propagation. European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Sep 2008, Antwerp, Belgium. ⟨inria-00289679v3⟩