Towards Word Semantics from Multi-modal Acoustico-Motor Integration: Application of the Bijama Model to the Setting of Action-Dependant Phonetic Representations

Olivier Ménard (1) , Hervé Frezza-Buet (1) , Frédéric Alexandre (1)

1 CORTEX - Neuromimetic intelligence

This paper presents a computational self-organizing model of multi-modal information, inspired from cortical maps. It shows how the organization in a map can be influenced by the same process occurring in other maps. We illustrate this approach on a phonetic - motor association, that shows that the organization of words can integrate motor constraints, as observed in humans.

Mots clés: continuum neural field theory self-organized maps multi-modal

Olivier Ménard, Hervé Frezza-Buet, Frédéric Alexandre. Towards Word Semantics from Multi-modal Acoustico-Motor Integration: Application of the Bijama Model to the Setting of Action-Dependant Phonetic Representations. Stefan Wermter and Günther Palm and Mark Elshaw. Biomimetic Neural Learning for Intelligent Robots: Intelligent Systems, Cognitive Robotics, and Neuroscience, 3575 (3575), Springer-Verlag, pp.144--161, 2005, Lecture Notes in Artificial Intelligence, 3-540-27440-5. ⟨10.1007/b139051⟩. ⟨inria-00000634⟩