We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Points2NeRF: Generating Neural Radiance Fields from 3D point cloud

Abstract: Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods address this problem by fitting a mesh to the point cloud and rendering it instead. This approach, however, leads to the reduced fidelity of the resulting visualization and misses color information of the objects crucial in computer graphics applications. In this work, we propose to mitigate this challenge by representing 3D objects as Neural Radiance Fields (NeRFs). We leverage a hypernetwork paradigm and train the model to take a 3D point cloud with the associated color values and return a NeRF network's weights that reconstruct 3D objects from input 2D images. Our method provides efficient 3D object representation and offers several advantages over the existing approaches, including the ability to condition NeRFs and improved generalization beyond objects seen in training. The latter we also confirmed in the results of our empirical evaluation.
Comments: arXiv admin note: text overlap with arXiv:2003.08934 by other authors
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2206.01290 [cs.CV]
  (or arXiv:2206.01290v2 [cs.CV] for this version)

Submission history

From: Przemysław Spurek [view email]
[v1] Thu, 2 Jun 2022 20:23:33 GMT (1112kb,D)
[v2] Sat, 13 May 2023 16:15:25 GMT (1393kb,D)

Link back to: arXiv, form interface, contact.