We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.AS

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Sound

Title: FloWaveNet : A Generative Flow for Raw Audio

Abstract: Most modern text-to-speech architectures use a WaveNet vocoder for synthesizing high-fidelity waveform audio, but there have been limitations, such as high inference time, in its practical application due to its ancestral sampling scheme. The recently suggested Parallel WaveNet and ClariNet have achieved real-time audio synthesis capability by incorporating inverse autoregressive flow for parallel sampling. However, these approaches require a two-stage training pipeline with a well-trained teacher network and can only produce natural sound by using probability distillation along with auxiliary loss terms. We propose FloWaveNet, a flow-based generative model for raw audio synthesis. FloWaveNet requires only a single-stage training procedure and a single maximum likelihood loss, without any additional auxiliary terms, and it is inherently parallel due to the characteristics of generative flow. The model can efficiently sample raw audio in real-time, with clarity comparable to previous two-stage parallel models. The code and samples for all models, including our FloWaveNet, are publicly available.
Comments: 9 pages, ICML'2019
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
Cite as: arXiv:1811.02155 [cs.SD]
  (or arXiv:1811.02155v3 [cs.SD] for this version)

Submission history

From: Sungwon Kim [view email]
[v1] Tue, 6 Nov 2018 04:30:41 GMT (536kb,D)
[v2] Sat, 10 Nov 2018 10:01:49 GMT (536kb,D)
[v3] Mon, 20 May 2019 06:37:47 GMT (8422kb,D)

Link back to: arXiv, form interface, contact.