PUC Minas and IRISA at Multimodal Person Discovery

Gabriel Sargent (1) , Gabriel Barbosa de Fonseca (2) , Izabela Lyon Freire (2) , Ronan Sicre (1) , Zenilton K G Do Patrocínio Jr. (2) , Silvio J. Guimarães (2) , Guillaume Gravier (1)

1 LinkMedia - Creating and exploiting explicit links between multimedia fragments
2 PUC Minas

This paper describes the systems developed by PUC Minas and IRISA for the person discovery task at MediaEval 2016. We adopt a graph-based representation and investigate two tag-propagation approaches to associate overlays co-occurring with some speaking faces to other visually or audiovisually similar speaking faces. Given a video, we first build a graph from the detected speaking faces (nodes) and their audiovisual similarities (edges). Each node is associated to its co-occurring overlays (tags) when they exist. Then, we consider two tag-propagation approaches, respectively based on a random walk strategy and on Kruskal's algorithm.

Domaines: Multimédia [cs.MM]; Son [cs.SD]; Traitement du signal et de l'image [eess.SP]; Traitement du texte et du document; Vision par ordinateur et reconnaissance de formes [cs.CV]; Apprentissage [cs.LG]

Gabriel Sargent, Gabriel Barbosa de Fonseca, Izabela Lyon Freire, Ronan Sicre, Zenilton K G Do Patrocínio Jr., et al.. PUC Minas and IRISA at Multimodal Person Discovery. Working Notes Proceedings of the MediaEval Workshop, Oct 2016, Hilversum, Netherlands. ⟨hal-01400261⟩