Do oral messages help visual search?

Noëlle Carbonell (1) , Suzanne Kieffer (1)

1 MERLIN - Methods for interactive software ergonomics

A preliminary experimental study is presented, that aims at eliciting the contribution of oral messages to facilitating visual search tasks on crowded visual displays. Results of quantitative and qualitative analyses suggest that appropriate verbal messages can improve both target selection time and accuracy. In particular, multimodal messages including a visual presentation of the isolated target together with absolute spatial oral information on its location in the displayed scene seem most effective. These messages also got top-ranking ratings from most subjects.

Mots clés: Multimodal interaction; Multimedia presentations; Visual search; Spatial oral messages; Speech and graphics; Usability experimental study

Domaines: Interface homme-machine [cs.HC]

Noëlle Carbonell, Suzanne Kieffer. Do oral messages help visual search?. J. van Kuppevelt, L. Dybkjaer, N.O. Bernsen. Advances in Natural Multimodal Dialogue Systems, Dordrecht (NL) Springer, pp. 131-157, 2005, Vol. 30, 'Text, Speech and Language Technology' Series, ⟨10.1007/1-4020-3933-6_7⟩. ⟨hal-00168245⟩