Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Towards achieving robust universal neural vocoding
(Submitted on 15 Nov 2018 (v1), last revised 4 Jul 2019 (this version, v2))
Abstract: This paper explores the potential universality of neural vocoders. We train a WaveRNN-based vocoder on 74 speakers coming from 17 languages. This vocoder is shown to be capable of generating speech of consistently good quality (98% relative mean MUSHRA when compared to natural speech) regardless of whether the input spectrogram comes from a speaker or style seen during training or from an out-of-domain scenario when the recording conditions are studio-quality. When the recordings show significant changes in quality, or when moving towards non-speech vocalizations or singing, the vocoder still significantly outperforms speaker-dependent vocoders, but operates at a lower average relative MUSHRA of 75%. These results are shown to be consistent across languages, regardless of them being seen during training (e.g. English or Japanese) or unseen (e.g. Wolof, Swahili, Ahmaric).
Submission history
From: Jaime Lorenzo-Trueba [view email][v1] Thu, 15 Nov 2018 10:54:13 GMT (165kb,D)
[v2] Thu, 4 Jul 2019 15:50:14 GMT (167kb,D)
Link back to: arXiv, form interface, contact.