We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.AS

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Audio and Speech Processing

Title: Speaker-adaptive neural vocoders for parametric speech synthesis systems

Abstract: This paper proposes speaker-adaptive neural vocoders for parametric text-to-speech (TTS) systems. Recently proposed WaveNet-based neural vocoding systems successfully generate a time sequence of speech signal with an autoregressive framework. However, it remains a challenge to synthesize high-quality speech when the amount of a target speaker's training data is insufficient. To generate more natural speech signals with the constraint of limited training data, we propose a speaker adaptation task with an effective variation of neural vocoding models. In the proposed method, a speaker-independent training method is applied to capture universal attributes embedded in multiple speakers, and the trained model is then optimized to represent the specific characteristics of the target speaker. Experimental results verify that the proposed TTS systems with speaker-adaptive neural vocoders outperform those with traditional source-filter model-based vocoders and those with WaveNet vocoders, trained either speaker-dependently or speaker-independently. In particular, our TTS system achieves 3.80 and 3.77 MOS for the Korean male and Korean female speakers, respectively, even though we use only ten minutes' speech corpus for training the model.
Comments: Accepted to the IEEE Workshop of MMSP 2020
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
Cite as: arXiv:1811.03311 [eess.AS]
  (or arXiv:1811.03311v5 [eess.AS] for this version)

Submission history

From: Eunwoo Song [view email]
[v1] Thu, 8 Nov 2018 08:26:03 GMT (257kb,D)
[v2] Thu, 4 Apr 2019 10:02:21 GMT (257kb,D)
[v3] Tue, 9 Apr 2019 05:42:05 GMT (257kb,D)
[v4] Fri, 28 Jun 2019 06:42:43 GMT (257kb,D)
[v5] Sat, 1 Aug 2020 05:24:15 GMT (276kb,D)

Link back to: arXiv, form interface, contact.