A Generative Audio-Visual Prosodic Model for Virtual Actors

Adela Barbulescu (1) , Rémi Ronfard (2) , Gérard Bailly (1)

1 GIPSA-CRISSP - GIPSA - Cognitive Robotics, Interactive Systems, & Speech Processing
2 IMAGINE - Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments

An important problem in the animation of virtual characters is the expression of complex mental states using the coordinated prosody of voice, rhythm, facial expressions, and head and gaze motion. The authors propose a method for generating natural speech and facial animation in various attitudes using neutral speech and animation as input.

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]

Adela Barbulescu, Rémi Ronfard, Gérard Bailly. A Generative Audio-Visual Prosodic Model for Virtual Actors. IEEE Computer Graphics and Applications, 2017, 37 (6), pp.40-51. ⟨10.1109/MCG.2017.4031070⟩. ⟨hal-01643334⟩