Probabilistic modeling paradigms for audio source separation

Emmanuel Vincent (1) , Maria G. Jafari (2) , Samer A. Abdallah (2) , Mark D. Plumbley (2) , Mike E. Davies (3)

1 METISS - Speech and sound data modeling and processing
2 Centre for Digital Music
3 Institute for Digital Communication Joint Research Institute for Signal & Image Processing School of Engineering and Electronics - University of Edinburgh

Most sound scenes result from the superposition of several sources, which can be separately perceived and analyzed by human listeners. Source separation aims to provide machine listeners with similar skills by extracting the sounds of individual sources from a given scene. Existing separation systems operate either by emulating the human auditory system or by inferring the parameters of probabilistic sound models. In this chapter, we focus on the latter approach and provide a joint overview of established and recent models, including independent component analysis, local time-frequency models and spectral template-based models. We show that most models are instances of one of the following two general paradigms: linear modeling or variance modeling. We compare the merits of either paradigm and report objective performance figures. We conclude by discussing promising combinations of probabilistic priors and inference algorithms that could form the basis of future state-of-the-art systems.

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Emmanuel Vincent, Maria G. Jafari, Samer A. Abdallah, Mark D. Plumbley, Mike E. Davies. Probabilistic modeling paradigms for audio source separation. W. Wang. Machine Audition: Principles, Algorithms and Systems, IGI Global, pp.162--185, 2010, ⟨10.4018/978-1-61520-919-4.ch007⟩. ⟨inria-00544016⟩