References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: 3D Shape Generation and Completion through Point-Voxel Diffusion
(Submitted on 8 Apr 2021 (v1), last revised 29 Aug 2021 (this version, v3))
Abstract: We propose a novel approach for probabilistic generative modeling of 3D shapes. Unlike most existing models that learn to deterministically translate a latent vector to a shape, our model, Point-Voxel Diffusion (PVD), is a unified, probabilistic formulation for unconditional shape generation and conditional, multi-modal shape completion. PVD marries denoising diffusion models with the hybrid, point-voxel representation of 3D shapes. It can be viewed as a series of denoising steps, reversing the diffusion process from observed point cloud data to Gaussian noise, and is trained by optimizing a variational lower bound to the (conditional) likelihood function. Experiments demonstrate that PVD is capable of synthesizing high-fidelity shapes, completing partial point clouds, and generating multiple completion results from single-view depth scans of real objects.
Submission history
From: Linqi Zhou [view email][v1] Thu, 8 Apr 2021 10:38:03 GMT (18726kb,D)
[v2] Sun, 11 Apr 2021 22:11:25 GMT (18724kb,D)
[v3] Sun, 29 Aug 2021 23:03:30 GMT (18859kb,D)
Link back to: arXiv, form interface, contact.