We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Unsupervised Learning of Monocular Depth and Ego-Motion Using Multiple Masks

Abstract: A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of depth and ego-motion without truth values. The main contribution of our method is to carefully consider the occlusion of the pixels generated when the adjacent frames are projected to each other, and the blank problem generated in the projection target imaging plane. Two fine masks are designed to solve most of the image pixel mismatch caused by the movement of the camera. In addition, some relatively rare circumstances are considered, and repeated masking is proposed. To some extent, the method is to use a geometric relationship to filter the mismatched pixels for training, making unsupervised learning more efficient and accurate. The experiments on KITTI dataset show our method achieves good performance in terms of depth and ego-motion. The generalization capability of our method is demonstrated by training on the low-quality uncalibrated bike video dataset and evaluating on KITTI dataset, and the results are still good.
Comments: Accepted to ICRA 2019
Subjects: Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
Journal reference: 2019 International Conference on Robotics and Automation (ICRA). IEEE, 2019, pp. 4724-4730
DOI: 10.1109/ICRA.2019.8793622
Cite as: arXiv:2104.00431 [cs.CV]
  (or arXiv:2104.00431v1 [cs.CV] for this version)

Submission history

From: Guangming Wang [view email]
[v1] Thu, 1 Apr 2021 12:29:23 GMT (591kb)

Link back to: arXiv, form interface, contact.