We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Robotics

Title: Self-supervised Monocular Multi-robot Relative Localization with Efficient Deep Neural Networks

Abstract: Relative localization is an important ability for multiple robots to perform cooperative tasks in GPS-denied environment. This paper presents a novel autonomous positioning framework for monocular relative localization of multiple tiny flying robots. This approach does not require any groundtruth data from external systems or manual labelling. Instead, the proposed framework is able to label real-world images with 3D relative positions between robots based on another onboard relative estimation technology, using ultra-wide band (UWB). After training in this self-supervised manner, the proposed deep neural network (DNN) can predict relative positions of peer robots by purely using a monocular camera. This deep learning-based visual relative localization is scalable, distributed and autonomous. We also built an open-source and light-weight simulation pipeline by using Blender for 3D rendering, which allows synthetic image generation of other robots, and generalized training of the neural network. The proposed localization framework is tested on two real-world Crazyflie2 quadrotors by running the DNN on the onboard AIdeck (a tiny AI chip and monocular camera). All results demonstrate the effectiveness of the self-supervised multi-robot localization method.
Comments: 6+1 pages, submitted to ICRA 2022
Subjects: Robotics (cs.RO)
Cite as: arXiv:2105.12797 [cs.RO]
  (or arXiv:2105.12797v2 [cs.RO] for this version)

Submission history

From: Shushuai Li [view email]
[v1] Wed, 26 May 2021 19:06:57 GMT (3048kb,D)
[v2] Wed, 22 Sep 2021 07:32:09 GMT (4474kb,D)

Link back to: arXiv, form interface, contact.