We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: A framework for reinforcement learning with autocorrelated actions

Abstract: The subject of this paper is reinforcement learning. Policies are considered here that produce actions based on states and random elements autocorrelated in subsequent time instants. Consequently, an agent learns from experiments that are distributed over time and potentially give better clues to policy improvement. Also, physical implementation of such policies, e.g. in robotics, is less problematic, as it avoids making robots shake. This is in opposition to most RL algorithms which add white noise to control causing unwanted shaking of the robots. An algorithm is introduced here that approximately optimizes the aforementioned policy. Its efficiency is verified for four simulated learning control problems (Ant, HalfCheetah, Hopper, and Walker2D) against three other methods (PPO, SAC, ACER). The algorithm outperforms others in three of these problems.
Comments: The 27th International Conference on Neural Information Processing (ICONIP2020)
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
ACM classes: I.2.6
Cite as: arXiv:2009.04777 [cs.LG]
  (or arXiv:2009.04777v1 [cs.LG] for this version)

Submission history

From: Paweł Wawrzyński [view email]
[v1] Thu, 10 Sep 2020 11:23:09 GMT (385kb,D)

Link back to: arXiv, form interface, contact.