Current browse context:
cs.AI
Change to browse by:
References & Citations
Computer Science > Artificial Intelligence
Title: Recurrent Environment Simulators
(Submitted on 7 Apr 2017 (v1), last revised 19 Apr 2017 (this version, v2))
Abstract: Models that can simulate how environments change in response to actions can be used by agents to plan and act efficiently. We improve on previous environment simulators from high-dimensional pixel observations by introducing recurrent neural networks that are able to make temporally and spatially coherent predictions for hundreds of time-steps into the future. We present an in-depth analysis of the factors affecting performance, providing the most extensive attempt to advance the understanding of the properties of these models. We address the issue of computationally inefficiency with a model that does not need to generate a high-dimensional image at each time-step. We show that our approach can be used to improve exploration and is adaptable to many diverse environments, namely 10 Atari games, a 3D car racing environment, and complex 3D mazes.
Submission history
From: Silvia Chiappa [view email][v1] Fri, 7 Apr 2017 14:53:54 GMT (6483kb,D)
[v2] Wed, 19 Apr 2017 15:43:32 GMT (6483kb,D)
Link back to: arXiv, form interface, contact.