Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Auxiliary Tasks Speed Up Learning PointGoal Navigation
(Submitted on 9 Jul 2020 (v1), last revised 4 Nov 2020 (this version, v2))
Abstract: PointGoal Navigation is an embodied task that requires agents to navigate to a specified point in an unseen environment. Wijmans et al. showed that this task is solvable but their method is computationally prohibitive, requiring 2.5 billion frames and 180 GPU-days. In this work, we develop a method to significantly increase sample and time efficiency in learning PointNav using self-supervised auxiliary tasks (e.g. predicting the action taken between two egocentric observations, predicting the distance between two observations from a trajectory,etc.).We find that naively combining multiple auxiliary tasks improves sample efficiency,but only provides marginal gains beyond a point. To overcome this, we use attention to combine representations learnt from individual auxiliary tasks. Our best agent is 5.5x faster to reach the performance of the previous state-of-the-art, DD-PPO, at 40M frames, and improves on DD-PPO's performance at 40M frames by 0.16 SPL. Our code is publicly available at this https URL
Submission history
From: Joel Ye [view email][v1] Thu, 9 Jul 2020 05:22:40 GMT (1577kb,D)
[v2] Wed, 4 Nov 2020 20:29:06 GMT (1557kb,D)
Link back to: arXiv, form interface, contact.