Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Speech Denoising with Auditory Models
(Submitted on 21 Nov 2020 (v1), last revised 13 Aug 2021 (this version, v3))
Abstract: Contemporary speech enhancement predominantly relies on audio transforms that are trained to reconstruct a clean speech waveform. The development of high-performing neural network sound recognition systems has raised the possibility of using deep feature representations as 'perceptual' losses with which to train denoising systems. We explored their utility by first training deep neural networks to classify either spoken words or environmental sounds from audio. We then trained an audio transform to map noisy speech to an audio waveform that minimized the difference in the deep feature representations between the output audio and the corresponding clean audio. The resulting transforms removed noise substantially better than baseline methods trained to reconstruct clean waveforms, and also outperformed previous methods using deep feature losses. However, a similar benefit was obtained simply by using losses derived from the filter bank inputs to the deep networks. The results show that deep features can guide speech enhancement, but suggest that they do not yet outperform simple alternatives that do not involve learned features.
Submission history
From: Mark Saddler [view email][v1] Sat, 21 Nov 2020 02:36:58 GMT (1473kb,D)
[v2] Fri, 11 Dec 2020 02:16:29 GMT (1473kb,D)
[v3] Fri, 13 Aug 2021 01:20:55 GMT (534kb,D)
Link back to: arXiv, form interface, contact.