Current browse context:
cs.SD
Change to browse by:
References & Citations
Computer Science > Sound
Title: WaveFlow: A Compact Flow-based Model for Raw Audio
(Submitted on 3 Dec 2019 (v1), last revised 24 Jun 2020 (this version, v4))
Abstract: In this work, we propose WaveFlow, a small-footprint generative flow for raw audio, which is directly trained with maximum likelihood. It handles the long-range structure of 1-D waveform with a dilated 2-D convolutional architecture, while modeling the local variations using expressive autoregressive functions. WaveFlow provides a unified view of likelihood-based models for 1-D data, including WaveNet and WaveGlow as special cases. It generates high-fidelity speech as WaveNet, while synthesizing several orders of magnitude faster as it only requires a few sequential steps to generate very long waveforms with hundreds of thousands of time-steps. Furthermore, it can significantly reduce the likelihood gap that has existed between autoregressive models and flow-based models for efficient synthesis. Finally, our small-footprint WaveFlow has only 5.91M parameters, which is 15$\times$ smaller than WaveGlow. It can generate 22.05 kHz high-fidelity audio 42.6$\times$ faster than real-time (at a rate of 939.3 kHz) on a V100 GPU without engineered inference kernels.
Submission history
From: Wei Ping [view email][v1] Tue, 3 Dec 2019 07:00:13 GMT (90kb,D)
[v2] Fri, 10 Jan 2020 21:45:31 GMT (1318kb,D)
[v3] Thu, 13 Feb 2020 21:35:04 GMT (1323kb,D)
[v4] Wed, 24 Jun 2020 20:10:12 GMT (1323kb,D)
Link back to: arXiv, form interface, contact.