Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: BAIL: Best-Action Imitation Learning for Batch Deep Reinforcement Learning
(Submitted on 27 Oct 2019 (v1), last revised 2 Nov 2020 (this version, v4))
Abstract: There has recently been a surge in research in batch Deep Reinforcement Learning (DRL), which aims for learning a high-performing policy from a given dataset without additional interactions with the environment. We propose a new algorithm, Best-Action Imitation Learning (BAIL), which strives for both simplicity and performance. BAIL learns a V function, uses the V function to select actions it believes to be high-performing, and then uses those actions to train a policy network using imitation learning. For the MuJoCo benchmark, we provide a comprehensive experimental study of BAIL, comparing its performance to four other batch Q-learning and imitation-learning schemes for a large variety of batch datasets. Our experiments show that BAIL's performance is much higher than the other schemes, and is also computationally much faster than the batch Q-learning schemes.
Submission history
From: Che Wang [view email][v1] Sun, 27 Oct 2019 04:43:19 GMT (7241kb,D)
[v2] Wed, 26 Feb 2020 11:26:19 GMT (7234kb,D)
[v3] Thu, 22 Oct 2020 05:28:24 GMT (13587kb,D)
[v4] Mon, 2 Nov 2020 07:11:07 GMT (13588kb,D)
Link back to: arXiv, form interface, contact.