Towards the design of usable multimodal interaction languages

Noëlle Carbonell (1)

1 MERLIN - Methods for interactive software ergonomics

This paper presents novel recommendations for the design of usable multimodal command or query languages. These recommendations have been inferred from the results of three empirical studies focused on the use of spontaneous speech (first study) and the synergic use of spontaneous versus controlled speech and gestures (second and third studies) for interacting with current application software. In particular, we propose a method for designing multimodal languages which can be considered as appropriate substitutes for direct manipulation, in all contexts precluding the use of mouse and keyboard, and for all standard categories of users, especially the general public. || Nous présentons de nouvelles recommandations pour la conception de langages d'interaction multimodaux robustes, faciles à apprendre et à utiliser. Ces recommandations ont été établies à partir des résultats de trois études empiriques sur l'usage spontané

Mots clés: speech user interfaces; gesture human-computer interaction; multimodal human-computer interaction; usability studies; interaction homme-machine gestuelle; interaction homme-machine multimodale; évaluation ergonomique; recommandations ergonomiques; ergonomic design recommendations; interfaces utilisateur orales

Domaines: Autre [cs.OH]

Noëlle Carbonell. Towards the design of usable multimodal interaction languages. Universal Access in the Information Society, 2003, Special issue on multimodality: a step towards universal access, 2 (2), pp.143-159. ⟨10.1007/s10209-003-0051-0⟩. ⟨inria-00099527⟩