We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: Alternate Endings: Improving Prosody for Incremental Neural TTS with Predicted Future Text Input

Abstract: The prosody of a spoken word is determined by its surrounding context. In incremental text-to-speech synthesis, where the synthesizer produces an output before it has access to the complete input, the full context is often unknown which can result in a loss of naturalness in the synthesized speech. In this paper, we investigate whether the use of predicted future text can attenuate this loss. We compare several test conditions of next future word: (a) unknown (zero-word), (b) language model predicted, (c) randomly predicted and (d) ground-truth. We measure the prosodic features (pitch, energy and duration) and find that predicted text provides significant improvements over a zero-word lookahead, but only slight gains over random-word lookahead. We confirm these results with a perceptive test.
Comments: 4 pages
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
Cite as: arXiv:2102.09914 [cs.CL]
  (or arXiv:2102.09914v2 [cs.CL] for this version)

Submission history

From: Brooke Stephenson [view email]
[v1] Fri, 19 Feb 2021 13:11:34 GMT (125kb,D)
[v2] Tue, 15 Jun 2021 08:13:39 GMT (149kb,D)

Link back to: arXiv, form interface, contact.