Spatial covariance models for under-determined reverberant audio source separation

Ngoc Q.K. Duong (1) , Emmanuel Vincent (1) , Rémi Gribonval (1)

1 METISS - Speech and sound data modeling and processing

The separation of under-determined convolutive audio mixtures is generally addressed in the time-frequency domain where the sources exhibit little overlap. Most previous approaches rely on the approximation of the mixing process by complex-valued multiplication in each frequency bin. This is equivalent to assuming that the spatial covariance matrix of each source, that is the covariance of its contribution to all mixture channels, has rank 1. In this paper, we propose to represent each source via a full-rank spatial covariance matrix instead, which better approximates reverberation. We also investigate a possible parameterization of this matrix stemming from the theory of statistical room acoustics. We illustrate the potential of the proposed approach over a stereo reverberant speech mixture.

Mots clés: Audio source separation; under-determined mixtures; reverberation; spatial covariance models

Domaines: Son [cs.SD]

Ngoc Q.K. Duong, Emmanuel Vincent, Rémi Gribonval. Spatial covariance models for under-determined reverberant audio source separation. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2009. WASPAA '09., Oct 2009, New Paltz, United States. pp. 129 - 132, ⟨10.1109/ASPAA.2009.5346503⟩. ⟨hal-00481529⟩