We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Artificial Intelligence

Title: Deep Reinforcement Learning, a textbook

Authors: Aske Plaat
Abstract: Deep reinforcement learning has gathered much attention recently. Impressive results were achieved in activities as diverse as autonomous driving, game playing, molecular recombination, and robotics. In all these fields, computer programs have taught themselves to solve difficult problems. They have learned to fly model helicopters and perform aerobatic manoeuvers such as loops and rolls. In some applications they have even become better than the best humans, such as in Atari, Go, poker and StarCraft. The way in which deep reinforcement learning explores complex environments reminds us of how children learn, by playfully trying out things, getting feedback, and trying again. The computer seems to truly possess aspects of human learning; this goes to the heart of the dream of artificial intelligence. The successes in research have not gone unnoticed by educators, and universities have started to offer courses on the subject. The aim of this book is to provide a comprehensive overview of the field of deep reinforcement learning. The book is written for graduate students of artificial intelligence, and for researchers and practitioners who wish to better understand deep reinforcement learning methods and their challenges. We assume an undergraduate-level of understanding of computer science and artificial intelligence; the programming language of this book is Python. We describe the foundations, the algorithms and the applications of deep reinforcement learning. We cover the established model-free and model-based methods that form the basis of the field. Developments go quickly, and we also cover advanced topics: deep multi-agent reinforcement learning, deep hierarchical reinforcement learning, and deep meta learning.
Comments: Revised version 2023, added description of Monte Carlo sampling and N-step algorithm, improved explanation of on-policy and off-policy learning. Preprint available by permission of Publisher
Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
DOI: 10.1007/978-981-19-0638-1
Cite as: arXiv:2201.02135 [cs.AI]
  (or arXiv:2201.02135v5 [cs.AI] for this version)

Submission history

From: Aske Plaat [view email]
[v1] Tue, 4 Jan 2022 11:47:21 GMT (20642kb,D)
[v2] Sat, 5 Feb 2022 23:32:44 GMT (20736kb,D)
[v3] Wed, 15 Jun 2022 22:43:10 GMT (20737kb,D)
[v4] Sun, 19 Jun 2022 11:01:26 GMT (20737kb,D)
[v5] Sun, 23 Apr 2023 08:53:57 GMT (20943kb,D)

Link back to: arXiv, form interface, contact.