Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Video Diffusion Models
(Submitted on 7 Apr 2022 (v1), last revised 22 Jun 2022 (this version, v2))
Abstract: Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial results. Our model is a natural extension of the standard image diffusion architecture, and it enables jointly training from image and video data, which we find to reduce the variance of minibatch gradients and speed up optimization. To generate long and higher resolution videos we introduce a new conditional sampling technique for spatial and temporal video extension that performs better than previously proposed methods. We present the first results on a large text-conditioned video generation task, as well as state-of-the-art results on established benchmarks for video prediction and unconditional video generation. Supplementary material is available at this https URL
Submission history
From: Jonathan Ho [view email][v1] Thu, 7 Apr 2022 14:08:02 GMT (7814kb,D)
[v2] Wed, 22 Jun 2022 20:22:29 GMT (7820kb,D)
Link back to: arXiv, form interface, contact.