Comprehensive Framework for MultiModal Meaning Representation

Ashwani Kumar (1) , Laurent Romary (1)

1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component

Most of the existing content representation language designs are anchored to a specific modality (such as speech). This paper describes the rationale behind the definition of MMIL, the interface language intended to be used as the exchange format between modules in the MIAMM project, where we try to build a juke box incorporating multiple modalities such as speech, Haptics and Graphics. This interface language has been conceived as a general format for representing multimodal content both at lower (e.g. linguistic analysis) and higher (e.g. communication within the dialogue manager) levels of representations.

Domaines: Informatique et langage [cs.CL]

Ashwani Kumar, Laurent Romary. Comprehensive Framework for MultiModal Meaning Representation. fifth International Workshop on Computational Semantics (IWCS-5), Jan 2003, Tilburg, Netherlands. ⟨inria-00525258⟩