Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Novelty Search in Representational Space for Sample Efficient Exploration
(Submitted on 28 Sep 2020 (v1), last revised 15 Apr 2022 (this version, v3))
Abstract: We present a new approach for efficient exploration which leverages a low-dimensional encoding of the environment learned with a combination of model-based and model-free objectives. Our approach uses intrinsic rewards that are based on the distance of nearest neighbors in the low dimensional representational space to gauge novelty. We then leverage these intrinsic rewards for sample-efficient exploration with planning routines in representational space for hard exploration tasks with sparse rewards. One key element of our approach is the use of information theoretic principles to shape our representations in a way so that our novelty reward goes beyond pixel similarity. We test our approach on a number of maze tasks, as well as a control problem and show that our exploration approach is more sample-efficient compared to strong baselines.
Submission history
From: Ruo Yu Tao [view email][v1] Mon, 28 Sep 2020 18:51:52 GMT (2558kb,D)
[v2] Wed, 21 Oct 2020 19:48:33 GMT (1869kb,D)
[v3] Fri, 15 Apr 2022 16:11:46 GMT (1873kb,D)
Link back to: arXiv, form interface, contact.