We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: World Programs for Model-Based Learning and Planning in Compositional State and Action Spaces

Abstract: Some of the most important tasks take place in environments which lack cheap and perfect simulators, thus hampering the application of model-free reinforcement learning (RL). While model-based RL aims to learn a dynamics model, in a more general case the learner does not know a priori what the action space is. Here we propose a formalism where the learner induces a world program by learning a dynamics model and the actions in graph-based compositional environments by observing state-state transition examples. Then, the learner can perform RL with the world program as the simulator for complex planning tasks. We highlight a recent application, and propose a challenge for the community to assess world program-based planning.
Comments: Accepted at the Generative Modeling and Model-Based Reasoning for Robotics and AI workshop at ICML 2019. Presented on June 14th 2019. See this https URL
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Journal reference: https://sites.google.com/view/mbrl-icml2019
Cite as: arXiv:1912.13007 [cs.LG]
  (or arXiv:1912.13007v1 [cs.LG] for this version)

Submission history

From: Marwin Segler [view email]
[v1] Mon, 30 Dec 2019 17:03:16 GMT (78kb,D)

Link back to: arXiv, form interface, contact.