Skip to Main content Skip to Navigation
Journal articles

CountNet: Estimating the Number of Concurrent Speakers Using Supervised Learning

Fabian-Robert Stöter 1 Soumitro Chakrabarty 2 Bernd Edler 2 Emanuël A. P. Habets 2 
1 ZENITH - Scientific Data Management
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Estimating the maximum number of concurrent speakers from single-channel mixtures is a challenging problem and an essential first step to address various audio-based tasks such as blind source separation, speaker diarization, and audio surveillance. We propose a unifying probabilistic paradigm, where deep neural network architectures are used to infer output posterior distributions. These probabilities are in turn processed to yield discrete point estimates. Designing such architectures often involves two important and complementary aspects that we investigate and discuss. First, we study how recent advances in deep architectures may be exploited for the task of speaker count estimation. In particular, we show that convolutional recurrent neural networks outperform recurrent networks used in a previous study when adequate input features are used. Even for short segments of speech mixtures, we can estimate up to five speakers, with a significantly lower error than other methods. Second, through comprehensive evaluation, we compare the best-performing method to several baselines, as well as the influence of gain variations, different data sets, and reverberation. The output of our proposed method is compared to human performance. Finally, we give insights into the strategy used by our proposed method.
Document type :
Journal articles
Complete list of metadata

Cited literature [87 references]  Display  Hide  Download
Contributor : Isabelle Gouat Connect in order to contact the contributor
Submitted on : Monday, March 2, 2020 - 7:37:14 PM
Last modification on : Friday, August 5, 2022 - 3:03:28 PM
Long-term archiving on: : Wednesday, June 3, 2020 - 4:52:59 PM


Files produced by the author(s)




Fabian-Robert Stöter, Soumitro Chakrabarty, Bernd Edler, Emanuël A. P. Habets. CountNet: Estimating the Number of Concurrent Speakers Using Supervised Learning. IEEE/ACM Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing, 27 (2), pp.268-282. ⟨10.1109/TASLP.2018.2877892⟩. ⟨lirmm-02010805⟩



Record views


Files downloads