References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Exploring Geometric Consistency for Monocular 3D Object Detection
(Submitted on 12 Apr 2021 (v1), last revised 22 May 2022 (this version, v2))
Abstract: This paper investigates the geometric consistency for monocular 3D object detection, which suffers from the ill-posed depth estimation. We first conduct a thorough analysis to reveal how existing methods fail to consistently localize objects when different geometric shifts occur. In particular, we design a series of geometric manipulations to diagnose existing detectors and then illustrate their vulnerability to consistently associate the depth with object apparent sizes and positions. To alleviate this issue, we propose four geometry-aware data augmentation approaches to enhance the geometric consistency of the detectors. We first modify some commonly used data augmentation methods for 2D images so that they can maintain geometric consistency in 3D spaces. We demonstrate such modifications are important. In addition, we propose a 3D-specific image perturbation method that employs the camera movement. During the augmentation process, the camera system with the corresponding image is manipulated, while the geometric visual cues for depth recovery are preserved. We show that by using the geometric consistency constraints, the proposed augmentation techniques lead to improvements on the KITTI and nuScenes monocular 3D detection benchmarks with state-of-the-art results. In addition, we demonstrate that the augmentation methods are well suited for semi-supervised training and cross-dataset generalization.
Submission history
From: Qing Lian [view email][v1] Mon, 12 Apr 2021 23:12:48 GMT (16302kb,D)
[v2] Sun, 22 May 2022 01:23:21 GMT (13483kb,D)
Link back to: arXiv, form interface, contact.