CountNet: Estimating the Number of Concurrent Speakers Using Supervised Learning

Fabian Robert-Stöter 1 Soumitro Chakrabarty 2 Bernd Edler 2 Emanuël Habets 2
1 ZENITH - Scientific Data Management
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Estimating the maximum number of concurrent speakers from single-channel mixtures is a challenging problem and an essential first step to address various audio-based tasks such as blind source separation, speaker diarization, and audio surveillance. We propose a unifying probabilistic paradigm, where deep neural network architectures are used to infer output posterior distributions. These probabilities are in turn processed to yield discrete point estimates. Designing such architectures often involves two important and complementary aspects that we investigate and discuss. First, we study how recent advances in deep architectures may be exploited for the task of speaker count estimation. In particular, we show that convolutional recurrent neural networks outperform recurrent networks used in a previous study when adequate input features are used. Even for short segments of speech mixtures, we can estimate up to five speakers, with a significantly lower error than other methods. Second, through comprehensive evaluation, we compare the best-performing method to several baselines, as well as the influence of gain variations, different data sets, and reverberation. The output of our proposed method is compared to human performance. Finally, we give insights into the strategy used by our proposed method.
Document type :
Journal articles
Complete list of metadatas

https://hal-lirmm.ccsd.cnrs.fr/lirmm-02010805
Contributor : Isabelle Gouat <>
Submitted on : Thursday, February 7, 2019 - 2:37:39 PM
Last modification on : Thursday, October 17, 2019 - 3:32:03 PM

Identifiers

Collections

Citation

Fabian Robert-Stöter, Soumitro Chakrabarty, Bernd Edler, Emanuël Habets. CountNet: Estimating the Number of Concurrent Speakers Using Supervised Learning. IEEE/ACM Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing, 27 (2), pp.268-282. ⟨10.1109/TASLP.2018.2877892⟩. ⟨lirmm-02010805⟩

Share

Metrics

Record views

98