Lexical-phonetic automata for spoken utterance indexing and retrieval

Julien Fayolle (1) , Murat Saraclar (2) , Fabienne Moreau (1) , Christian Raymond (1) , Guillaume Gravier (1)

1 TEXMEX - Multimedia content-based indexing
2 BUSIM Speech Group

This paper presents a method for indexing spoken utterances which combines lexical and phonetic hypotheses in a hybrid index built from automata. The retrieval is realised by a lexical-phonetic and semi-imperfect matching whose aim is to improve the recall. A feature vector, containing edit distance scores and a confidence measure, weights each transition to help the filtering of the candidate utterance list for a more precise search. Experiment results show that the lexical and phonetic representations are complementary and we compare the hybrid search with the state-of-the-art cascaded search to retrieve named entity queries.

Mots clés: information retrieval; speech indexing; lexical-phonetic automata; confidence measures; edit distances; supervised learning

Domaines: Informatique et langage [cs.CL]

Julien Fayolle, Murat Saraclar, Fabienne Moreau, Christian Raymond, Guillaume Gravier. Lexical-phonetic automata for spoken utterance indexing and retrieval. International Conference on Speech Communication and Technologies, Sep 2012, Portland, United States. ⟨hal-00757765⟩