Discovering motion hierarchies via tree-structured coding of trajectories

Juan-Manuel Pérez-Rúa (1, 2) , Tomas Crivelli (2) , Patrick Pérez (2) , Patrick Bouthemy (1)

1 SERPICO - Space-timE RePresentation, Imaging and cellular dynamics of molecular COmplexes
2 Technicolor [Cesson Sévigné]

The dynamic content of physical scenes is largely compositional, that is, the movements of the objects and of their parts are hierarchically organised and relate through composition along this hierarchy. This structure also prevails in the apparent 2D motion that a video captures. Accessing this visual motion hierarchy is important to get a better understanding of dynamic scenes and is useful for video manipulation. We propose to capture it through learned, tree-structured sparse coding of point trajectories. We leverage this new representation within an unsupervised clustering scheme to partition hierarchically the trajectories into meaningful groups. We show through experiments on motion capture data that our model is able to extract moving segments along with their organisation. We also present competitive results on the task of segmenting objects in video sequences from trajectories.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Juan-Manuel Pérez-Rúa, Tomas Crivelli, Patrick Pérez, Patrick Bouthemy. Discovering motion hierarchies via tree-structured coding of trajectories. Proceedings of the British Machine Vision Conference 2016, BMVA, Sep 2016, York, United Kingdom. ⟨hal-01358454⟩