Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Multi-Channel End-to-End Neural Diarization with Distributed Microphones
(Submitted on 10 Oct 2021 (v1), last revised 28 Mar 2022 (this version, v2))
Abstract: Recent progress on end-to-end neural diarization (EEND) has enabled overlap-aware speaker diarization with a single neural network. This paper proposes to enhance EEND by using multi-channel signals from distributed microphones. We replace Transformer encoders in EEND with two types of encoders that process a multi-channel input: spatio-temporal and co-attention encoders. Both are independent of the number and geometry of microphones and suitable for distributed microphone settings. We also propose a model adaptation method using only single-channel recordings. With simulated and real-recorded datasets, we demonstrated that the proposed method outperformed conventional EEND when a multi-channel input was given while maintaining comparable performance with a single-channel input. We also showed that the proposed method performed well even when spatial information is inoperative given multi-channel inputs, such as in hybrid meetings in which the utterances of multiple remote participants are played back from the same loudspeaker.
Submission history
From: Shota Horiguchi [view email][v1] Sun, 10 Oct 2021 03:24:03 GMT (142kb,D)
[v2] Mon, 28 Mar 2022 10:49:09 GMT (142kb,D)
Link back to: arXiv, form interface, contact.