Faces and Thoughts: An Empathic Dairy

José Mennesson (1) , Benjamin Allaert (1) , Ioan Marius Bilasco (2, 3) , Nico van Der Aa (4) , Alexandre A. J. Denis (5) , Samuel Cruz-Lara (5)

1 CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
2 LIFL - FOX MIIRE
3 Université de Lille, Sciences et Technologies
4 Noldus Information Technology B.V.
5 SYNALP - Natural Language Processing : representations, inference and semantics

Many diary apps have been developed for an Android mobile device. Although most concentrate on securing the privacy and adding emoticons, only a few include automatic emotion measurements. This demo shows a new diary app including real-time multi-modal emotion measurements to capture the affective state of the user from the text provided and video images made. The emotion measurements from the Emotion from Face module, that analyzes images from the front camera, and the Emotion from Text module, that analyzes the text written by the user, are merged within the Emotion Fusion module to estimate the user’s affective state more robustly. The app allows the user to have empathic feedback for each session. http://bit.ly/emp_diary_fg

Domaines: Multimédia [cs.MM]; Traitement des images [eess.IV]; Traitement du texte et du document

José Mennesson, Benjamin Allaert, Ioan Marius Bilasco, Nico van Der Aa, Alexandre A. J. Denis, et al.. Faces and Thoughts: An Empathic Dairy. IEEE International Conference on Automatic Face and Gesture Recognition, IEEE, May 2015, Ljubljana, Slovenia. ⟨hal-01150212⟩