We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: CD$^2$: Fine-grained 3D Mesh Reconstruction With Twice Chamfer Distance

Abstract: Monocular 3D reconstruction is to reconstruct the shape of object and its other information from a single RGB image. In 3D reconstruction, polygon mesh, with detailed surface information and low computational cost, is the most prevalent expression form obtained from deep learning models. However, the state-of-the-art schemes fail to directly generate well-structured meshes, and we identify that most meshes have severe Vertices Clustering (VC) and Illegal Twist (IT) problems. By analyzing the mesh deformation process, we pinpoint that the inappropriate usage of Chamfer Distance (CD) loss is a root cause of VC and IT problems in deep learning model. In this paper, we initially demonstrate these two problems induced by CD loss with visual examples and quantitative analyses. Then, we propose a fine-grained reconstruction method CD$^2$ by employing Chamfer distance twice to perform a plausible and adaptive deformation. Extensive experiments on two 3D datasets and comparisons with five latest schemes demonstrate that our CD$^2$ directly generates a well-structured mesh and outperforms others in terms of several quantitative metrics.
Comments: Just accepted by TOMM
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2206.00447 [cs.CV]
  (or arXiv:2206.00447v3 [cs.CV] for this version)

Submission history

From: Mai Su [view email]
[v1] Wed, 1 Jun 2022 12:29:25 GMT (7136kb,D)
[v2] Thu, 3 Nov 2022 15:28:03 GMT (15718kb,D)
[v3] Sun, 29 Jan 2023 16:02:20 GMT (11726kb,D)

Link back to: arXiv, form interface, contact.