An introduction to multichannel NMF for audio source separation

Alexey Ozerov (1) , Cédric Févotte (2, 3) , Emmanuel Vincent (4)

1 Technicolor R & I [Cesson Sévigné]
2 IRIT-SC - Signal et Communications
3 CNRS - Centre National de la Recherche Scientifique
4 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication

This chapter introduces multichannel nonnegative matrix factorization (NMF) methods for audio source separation. All the methods and some of their extensions are introduced within a more general local Gaussian modeling (LGM) framework. These methods are very attractive since allow combining spatial and spectral cues in a joint and principal way, but also are natural extensions and generalizations of many single-channel NMF-based methods to the multichannel case. The chapter introduces the spectral (NMF-based) and spatial models, as well as the way to combine them within the LGM framework. Model estimation criteria and algorithms are described as well, while going deeper into details of some of them.

Domaines: Traitement du signal et de l'image [eess.SP]

Alexey Ozerov, Cédric Févotte, Emmanuel Vincent. An introduction to multichannel NMF for audio source separation. Audio Source Separation, Springer, 2018, Signals and Communication Technology. ⟨hal-01631187v2⟩