Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Speaker activity driven neural speech extraction
(Submitted on 14 Jan 2021 (v1), last revised 9 Feb 2021 (this version, v2))
Abstract: Target speech extraction, which extracts the speech of a target speaker in a mixture given auxiliary speaker clues, has recently received increased interest. Various clues have been investigated such as pre-recorded enrollment utterances, direction information, or video of the target speaker. In this paper, we explore the use of speaker activity information as an auxiliary clue for single-channel neural network-based speech extraction. We propose a speaker activity driven speech extraction neural network (ADEnet) and show that it can achieve performance levels competitive with enrollment-based approaches, without the need for pre-recordings. We further demonstrate the potential of the proposed approach for processing meeting-like recordings, where the speaker activity is obtained from a diarization system. We show that this simple yet practical approach can successfully extract speakers after diarization, which results in improved ASR performance, especially in high overlapping conditions, with a relative word error rate reduction of up to 25%.
Submission history
From: Marc Delcroix [view email][v1] Thu, 14 Jan 2021 09:21:51 GMT (2447kb,D)
[v2] Tue, 9 Feb 2021 23:33:59 GMT (2447kb,D)
Link back to: arXiv, form interface, contact.