Estimation of Human Body Shape in Motion with Wide Clothing

Jinlong Yang (1) , Jean-Sébastien Franco (1) , Franck Hétroy-Wheeler (1) , Stefanie Wuhrer (1)

1 MORPHEO - Capture and Analysis of Shapes in Motion

Estimating 3D human body shape in motion from a sequence of unstructured oriented 3D point clouds is important for many applications. We propose the first automatic method to solve this problem that works in the presence of loose clothing. The problem is formulated as an optimization problem that solves for identity and posture parameters in a shape space capturing likely body shape variations. The automation is achieved by leveraging a recent robust pose detection method Stitched Puppet. To account for clothing, we take advantage of motion cues by encouraging the estimated body shape to be inside the observations. The method is evaluated on a new benchmark containing different subjects, motions, and clothing styles that allows to quantitatively measure the accuracy of body shape estimates. Furthermore, we compare our results to existing methods that require manual input and demonstrate that results of similar visual quality can be obtained.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Jinlong Yang, Jean-Sébastien Franco, Franck Hétroy-Wheeler, Stefanie Wuhrer. Estimation of Human Body Shape in Motion with Wide Clothing. ECCV 2016 - European Conference on Computer Vision 2016, Oct 2016, Amsterdam, Netherlands. pp.439-454, ⟨10.1007/978-3-319-46493-0_27⟩. ⟨hal-01344795v4⟩