We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Sound

Title: YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyone

Abstract: YourTTS brings the power of a multilingual approach to the task of zero-shot multi-speaker TTS. Our method builds upon the VITS model and adds several novel modifications for zero-shot multi-speaker and multilingual training. We achieved state-of-the-art (SOTA) results in zero-shot multi-speaker TTS and results comparable to SOTA in zero-shot voice conversion on the VCTK dataset. Additionally, our approach achieves promising results in a target language with a single-speaker dataset, opening possibilities for zero-shot multi-speaker TTS and zero-shot voice conversion systems in low-resource languages. Finally, it is possible to fine-tune the YourTTS model with less than 1 minute of speech and achieve state-of-the-art results in voice similarity and with reasonable quality. This is important to allow synthesis for speakers with a very different voice or recording characteristics from those seen during training.
Comments: An Erratum was added on the last page of this paper
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
Journal reference: Proceedings of the 39th International Conference on Machine Learning, PMLR 162:2709-2720, 2022
Cite as: arXiv:2112.02418 [cs.SD]
  (or arXiv:2112.02418v4 [cs.SD] for this version)

Submission history

From: Edresson Casanova [view email]
[v1] Sat, 4 Dec 2021 19:50:29 GMT (1172kb,D)
[v2] Sat, 29 Jan 2022 19:19:16 GMT (1171kb,D)
[v3] Wed, 16 Feb 2022 09:52:58 GMT (1171kb,D)
[v4] Sun, 30 Apr 2023 17:46:06 GMT (1171kb,D)

Link back to: arXiv, form interface, contact.