References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Semantic 3D Reconstruction with Continuous Regularization and Ray Potentials Using a Visibility Consistency Constraint
(Submitted on 11 Apr 2016 (v1), last revised 26 Aug 2019 (this version, v3))
Abstract: We propose an approach for dense semantic 3D reconstruction which uses a data term that is defined as potentials over viewing rays, combined with continuous surface area penalization. Our formulation is a convex relaxation which we augment with a crucial non-convex constraint that ensures exact handling of visibility. To tackle the non-convex minimization problem, we propose a majorize-minimize type strategy which converges to a critical point. We demonstrate the benefits of using the non-convex constraint experimentally. For the geometry-only case, we set a new state of the art on two datasets of the commonly used Middlebury multi-view stereo benchmark. Moreover, our general-purpose formulation directly reconstructs thin objects, which are usually treated with specialized algorithms. A qualitative evaluation on the dense semantic 3D reconstruction task shows that we improve significantly over previous methods.
Submission history
From: Nikolay Savinov [view email][v1] Mon, 11 Apr 2016 11:12:24 GMT (8502kb,D)
[v2] Sun, 22 May 2016 17:27:19 GMT (8499kb,D)
[v3] Mon, 26 Aug 2019 14:53:16 GMT (8498kb,D)
Link back to: arXiv, form interface, contact.