Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Exploring Timbre Disentanglement in Non-Autoregressive Cross-Lingual Text-to-Speech
(Submitted on 14 Oct 2021 (v1), last revised 31 Aug 2022 (this version, v3))
Abstract: In this paper, we study the disentanglement of speaker and language representations in non-autoregressive cross-lingual TTS models from various aspects. We propose a phoneme length regulator that solves the length mismatch problem between IPA input sequence and monolingual alignment results. Using the phoneme length regulator, we present a FastPitch-based cross-lingual model with IPA symbols as input representations. Our experiments show that language-independent input representations (e.g. IPA symbols), an increasing number of training speakers, and explicit modeling of speech variance information all encourage non-autoregressive cross-lingual TTS model to disentangle speaker and language representations. The subjective evaluation shows that our proposed model can achieve decent naturalness and speaker similarity in cross-language voice cloning.
Submission history
From: Haoyue Zhan [view email][v1] Thu, 14 Oct 2021 07:37:04 GMT (719kb,D)
[v2] Wed, 13 Apr 2022 10:19:34 GMT (1460kb,D)
[v3] Wed, 31 Aug 2022 02:19:45 GMT (1457kb,D)
Link back to: arXiv, form interface, contact.