References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: H3DNet: 3D Object Detection Using Hybrid Geometric Primitives
(Submitted on 10 Jun 2020 (v1), last revised 23 Jul 2020 (this version, v3))
Abstract: We introduce H3DNet, which takes a colorless 3D point cloud as input and outputs a collection of oriented object bounding boxes (or BB) and their semantic labels. The critical idea of H3DNet is to predict a hybrid set of geometric primitives, i.e., BB centers, BB face centers, and BB edge centers. We show how to convert the predicted geometric primitives into object proposals by defining a distance function between an object and the geometric primitives. This distance function enables continuous optimization of object proposals, and its local minimums provide high-fidelity object proposals. H3DNet then utilizes a matching and refinement module to classify object proposals into detected objects and fine-tune the geometric parameters of the detected objects. The hybrid set of geometric primitives not only provides more accurate signals for object detection than using a single type of geometric primitives, but it also provides an overcomplete set of constraints on the resulting 3D layout. Therefore, H3DNet can tolerate outliers in predicted geometric primitives. Our model achieves state-of-the-art 3D detection results on two large datasets with real 3D scans, ScanNet and SUN RGB-D.
Submission history
From: Zaiwei Zhang [view email][v1] Wed, 10 Jun 2020 06:44:53 GMT (6633kb,D)
[v2] Sat, 13 Jun 2020 23:37:57 GMT (6662kb,D)
[v3] Thu, 23 Jul 2020 19:16:39 GMT (14093kb,D)
Link back to: arXiv, form interface, contact.