References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Project to Adapt: Domain Adaptation for Depth Completion from Noisy and Sparse Sensor Data
(Submitted on 3 Aug 2020 (v1), last revised 5 Aug 2020 (this version, v2))
Abstract: Depth completion aims to predict a dense depth map from a sparse depth input. The acquisition of dense ground truth annotations for depth completion settings can be difficult and, at the same time, a significant domain gap between real LiDAR measurements and synthetic data has prevented from successful training of models in virtual settings. We propose a domain adaptation approach for sparse-to-dense depth completion that is trained from synthetic data, without annotations in the real domain or additional sensors. Our approach simulates the real sensor noise in an RGB+LiDAR set-up, and consists of three modules: simulating the real LiDAR input in the synthetic domain via projections, filtering the real noisy LiDAR for supervision and adapting the synthetic RGB image using a CycleGAN approach. We extensively evaluate these modules against the state-of-the-art in the KITTI depth completion benchmark, showing significant improvements.
Submission history
From: Adrian Lopez Rodriguez [view email][v1] Mon, 3 Aug 2020 17:21:57 GMT (34345kb,D)
[v2] Wed, 5 Aug 2020 14:46:40 GMT (34345kb,D)
Link back to: arXiv, form interface, contact.