We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.AI

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Artificial Intelligence

Title: Self-Organizing Maps for Storage and Transfer of Knowledge in Reinforcement Learning

Abstract: The idea of reusing or transferring information from previously learned tasks (source tasks) for the learning of new tasks (target tasks) has the potential to significantly improve the sample efficiency of a reinforcement learning agent. In this work, we describe a novel approach for reusing previously acquired knowledge by using it to guide the exploration of an agent while it learns new tasks. In order to do so, we employ a variant of the growing self-organizing map algorithm, which is trained using a measure of similarity that is defined directly in the space of the vectorized representations of the value functions. In addition to enabling transfer across tasks, the resulting map is simultaneously used to enable the efficient storage of previously acquired task knowledge in an adaptive and scalable manner. We empirically validate our approach in a simulated navigation environment, and also demonstrate its utility through simple experiments using a mobile micro-robotics platform. In addition, we demonstrate the scalability of this approach, and analytically examine its relation to the proposed network growth mechanism. Further, we briefly discuss some of the possible improvements and extensions to this approach, as well as its relevance to real world scenarios in the context of continual learning.
Comments: 35 pages, 11 figures, Accepted in the journal Adaptive Behavior. arXiv admin note: substantial text overlap with arXiv:1807.07530
Subjects: Artificial Intelligence (cs.AI)
Journal reference: Adaptive Behavior 27 (2018) 111-126
DOI: 10.1177/1059712318818568
Cite as: arXiv:1811.08318 [cs.AI]
  (or arXiv:1811.08318v1 [cs.AI] for this version)

Submission history

From: Thommen George Karimpanal [view email]
[v1] Sun, 18 Nov 2018 07:27:21 GMT (2845kb)

Link back to: arXiv, form interface, contact.