We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.AS

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Audio and Speech Processing

Title: Matcha-TTS: A fast TTS architecture with conditional flow matching

Abstract: We introduce Matcha-TTS, a new encoder-decoder architecture for speedy TTS acoustic modelling, trained using optimal-transport conditional flow matching (OT-CFM). This yields an ODE-based decoder capable of high output quality in fewer synthesis steps than models trained using score matching. Careful design choices additionally ensure each synthesis step is fast to run. The method is probabilistic, non-autoregressive, and learns to speak from scratch without external alignments. Compared to strong pre-trained baseline models, the Matcha-TTS system has the smallest memory footprint, rivals the speed of the fastest models on long utterances, and attains the highest mean opinion score in a listening test. Please see this https URL for audio examples, code, and pre-trained models.
Comments: 5 pages, 3 figures. Final version, accepted to IEEE ICASSP 2024
Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)
MSC classes: 68T07
ACM classes: I.2.7; I.2.6; H.5.5
Cite as: arXiv:2309.03199 [eess.AS]
  (or arXiv:2309.03199v2 [eess.AS] for this version)

Submission history

From: Gustav Eje Henter [view email]
[v1] Wed, 6 Sep 2023 17:59:57 GMT (517kb,D)
[v2] Tue, 9 Jan 2024 21:02:34 GMT (521kb,D)

Link back to: arXiv, form interface, contact.