Tracking HOG Descriptors for Gesture Recognition

Mohamed Kaâniche (1) , François Brémond (1)

1 PULSAR - Perception Understanding Learning Systems for Activity Recognition

We introduce a new HoG (Histogram of Oriented Gradients) tracker for Gesture Recognition. Our main contribution is to build HoG trajectory descriptors (representing local motion) which are used for gesture recognition. First, we select for each individual in the scene a set of corner points to determine textured regions where to compute 2D HoG descriptors. Second, we track these 2D HoG descriptors in order to build temporal HoG descriptors. Lost descriptors are replaced by newly detected ones. Finally, we extract the local motion descriptors to learn offline a set of given gestures. Then, a new video can be classified according to the gesture occurring in the video. Results shows that the tracker performs well compared to KLT tracker [1]. The generated local motion descriptors are validated through gesture learning-classification using the KTH action database [2].

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Mohamed Kaâniche, François Brémond. Tracking HOG Descriptors for Gesture Recognition. AVSS 2009 - Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance, Sep 2009, Genova, Italy. pp.978-0-7695-3718-4, ⟨10.1109/AVSS.2009.26⟩. ⟨hal-00428697⟩