References & Citations
Computer Science > Sound
Title: Advancing the dimensionality reduction of speaker embeddings for speaker diarisation: disentangling noise and informing speech activity
(Submitted on 7 Oct 2021 (v1), last revised 3 Nov 2022 (this version, v3))
Abstract: The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as noise, adversely affecting performance. Our previous work has proposed an auto-encoder-based dimensionality reduction module to help remove the redundant information. However, they do not explicitly separate such information and have also been found to be sensitive to hyper-parameter values. To this end, we propose two contributions to overcome these issues: (i) a novel dimensionality reduction framework that can disentangle spurious information from the speaker embeddings; (ii) the use of speech activity vector to prevent the speaker code from representing the background noise. Through a range of experiments conducted on four datasets, our approach consistently demonstrates the state-of-the-art performance among models without system fusion.
Submission history
From: You Jin Kim [view email][v1] Thu, 7 Oct 2021 12:19:09 GMT (1306kb,D)
[v2] Tue, 29 Mar 2022 09:40:45 GMT (442kb,D)
[v3] Thu, 3 Nov 2022 09:21:30 GMT (357kb,D)
Link back to: arXiv, form interface, contact.