References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detection
(Submitted on 2 Jun 2021 (v1), last revised 15 Oct 2021 (this version, v3))
Abstract: In this paper, we introduce the task of multi-view RGB-based 3D object detection as an end-to-end optimization problem. To address this problem, we propose ImVoxelNet, a novel fully convolutional method of 3D object detection based on monocular or multi-view RGB images. The number of monocular images in each multi-view input can variate during training and inference; actually, this number might be unique for each multi-view input. ImVoxelNet successfully handles both indoor and outdoor scenes, which makes it general-purpose. Specifically, it achieves state-of-the-art results in car detection on KITTI (monocular) and nuScenes (multi-view) benchmarks among all methods that accept RGB images. Moreover, it surpasses existing RGB-based 3D object detection methods on the SUN RGB-D dataset. On ScanNet, ImVoxelNet sets a new benchmark for multi-view 3D object detection. The source code and the trained models are available at this https URL
Submission history
From: Danila Rukhovich [view email][v1] Wed, 2 Jun 2021 14:20:24 GMT (27496kb,D)
[v2] Fri, 20 Aug 2021 08:25:09 GMT (36616kb,D)
[v3] Fri, 15 Oct 2021 12:54:42 GMT (28891kb,D)
Link back to: arXiv, form interface, contact.