Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: From Speech-to-Speech Translation to Automatic Dubbing
(Submitted on 19 Jan 2020 (v1), last revised 2 Feb 2020 (this version, v3))
Abstract: We present enhancements to a speech-to-speech translation pipeline in order to perform automatic dubbing. Our architecture features neural machine translation generating output of preferred length, prosodic alignment of the translation with the original speech segments, neural text-to-speech with fine tuning of the duration of each utterance, and, finally, audio rendering to enriches text-to-speech output with background noise and reverberation extracted from the original audio. We report on a subjective evaluation of automatic dubbing of excerpts of TED Talks from English into Italian, which measures the perceived naturalness of automatic dubbing and the relative importance of each proposed enhancement.
Submission history
From: Marcello Federico [view email][v1] Sun, 19 Jan 2020 07:03:05 GMT (564kb,D)
[v2] Wed, 29 Jan 2020 00:12:30 GMT (564kb,D)
[v3] Sun, 2 Feb 2020 21:54:13 GMT (564kb,D)
Link back to: arXiv, form interface, contact.