Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Object-Oriented Dynamics Learning through Multi-Level Abstraction
(Submitted on 16 Apr 2019 (v1), last revised 5 Dec 2019 (this version, v4))
Abstract: Object-based approaches for learning action-conditioned dynamics has demonstrated promise for generalization and interpretability. However, existing approaches suffer from structural limitations and optimization difficulties for common environments with multiple dynamic objects. In this paper, we present a novel self-supervised learning framework, called Multi-level Abstraction Object-oriented Predictor (MAOP), which employs a three-level learning architecture that enables efficient object-based dynamics learning from raw visual observations. We also design a spatial-temporal relational reasoning mechanism for MAOP to support instance-level dynamics learning and handle partial observability. Our results show that MAOP significantly outperforms previous methods in terms of sample efficiency and generalization over novel environments for learning environment models. We also demonstrate that learned dynamics models enable efficient planning in unseen environments, comparable to true environment models. In addition, MAOP learns semantically and visually interpretable disentangled representations.
Submission history
From: Guangxiang Zhu [view email][v1] Tue, 16 Apr 2019 06:01:17 GMT (3026kb,D)
[v2] Sat, 25 May 2019 03:46:55 GMT (3026kb,D)
[v3] Sat, 30 Nov 2019 10:29:10 GMT (3412kb,D)
[v4] Thu, 5 Dec 2019 06:05:28 GMT (3412kb,D)
Link back to: arXiv, form interface, contact.