Acquisition and synchronization of multimodal articulatory data

Michael Aron (1) , Nicolas Ferveur (1) , Erwan Kerrien (1) , Marie-Odile Berger (1) , Yves Laprie (2)

1 MAGRIT - Visual Augmentation of Complex Environments
2 PAROLE - Analysis, perception and recognition of speech

This paper describes a setup to synchronize data used to track speech articulators during speech production. Our method couples together an ultrasound, an electromagnetic and an audio system to record speech sequences. The coupling requires a precise temporal synchronization, to know exactly the delay between the recording start of each modality, and to know the sampling rate of each modality. A complete setup and methods for automatically synchronizing data are described. The aim is to get a fast, low-cost and easily reproducible acquisition system in order to temporally align data.

Mots clés: articulatory data; speech production; ultrasound; electromagnetic sensors; temporal synchronization

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Michael Aron, Nicolas Ferveur, Erwan Kerrien, Marie-Odile Berger, Yves Laprie. Acquisition and synchronization of multimodal articulatory data. 8th Annual Conference of the International Speech Communication Association - Interspeech'07, Aug 2007, Antwerpen, Belgium. pp.1398-1401. ⟨inria-00165869⟩