References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: PLUMENet: Efficient 3D Object Detection from Stereo Images
(Submitted on 17 Jan 2021 (v1), last revised 1 Aug 2021 (this version, v3))
Abstract: 3D object detection is a key component of many robotic applications such as self-driving vehicles. While many approaches rely on expensive 3D sensors such as LiDAR to produce accurate 3D estimates, methods that exploit stereo cameras have recently shown promising results at a lower cost. Existing approaches tackle this problem in two steps: first depth estimation from stereo images is performed to produce a pseudo LiDAR point cloud, which is then used as input to a 3D object detector. However, this approach is suboptimal due to the representation mismatch, as the two tasks are optimized in two different metric spaces. In this paper we propose a model that unifies these two tasks and performs them in the same metric space. Specifically, we directly construct a pseudo LiDAR feature volume (PLUME) in 3D space, which is then used to solve both depth estimation and object detection tasks. Our approach achieves state-of-the-art performance with much faster inference times when compared to existing methods on the challenging KITTI benchmark.
Submission history
From: Bin Yang [view email][v1] Sun, 17 Jan 2021 05:11:38 GMT (6477kb,D)
[v2] Thu, 11 Mar 2021 19:32:16 GMT (8931kb,D)
[v3] Sun, 1 Aug 2021 03:40:28 GMT (4785kb,D)
Link back to: arXiv, form interface, contact.