IRISA at TRECVid2016: Crossmodality, Multimodality and Monomodality for Video Hyperlinking

Rémi Bois (1) , Vedran Vukotić (1) , Ronan Sicre (1) , Christian Raymond (1) , Guillaume Gravier (1) , Pascale Sébillot (1)

1 LinkMedia - Creating and exploiting explicit links between multimedia fragments

This paper presents the runs that were submitted to the TRECVid Challenge 2016 for the Video Hyperlinking task. The task aims at proposing a set of video segments, called targets, to complement a query video segment defined as anchor. The 2016 edition of the task encouraged participants to use multiple modalities. In this context, we chose to submit four runs in order to assess the pros and cons of using two modalities instead of a single one and how crossmodality differs from multimodality in terms of relevance. The crossmodal run performed best and obtained the best precision at rank 5 among participants.

Domaines: Multimédia [cs.MM]; Son [cs.SD]; Traitement du signal et de l'image [eess.SP]; Traitement du texte et du document; Vision par ordinateur et reconnaissance de formes [cs.CV]; Apprentissage [cs.LG]

Rémi Bois, Vedran Vukotić, Ronan Sicre, Christian Raymond, Guillaume Gravier, et al.. IRISA at TRECVid2016: Crossmodality, Multimodality and Monomodality for Video Hyperlinking. Working Notes of the TRECVid 2016 Workshop, 2016, Gaithersburg, United States. ⟨hal-01400275⟩