Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Provably adaptive reinforcement learning in metric spaces
(Submitted on 18 Jun 2020 (v1), last revised 20 Oct 2021 (this version, v2))
Abstract: We study reinforcement learning in continuous state and action spaces endowed with a metric. We provide a refined analysis of a variant of the algorithm of Sinclair, Banerjee, and Yu (2019) and show that its regret scales with the \emph{zooming dimension} of the instance. This parameter, which originates in the bandit literature, captures the size of the subsets of near optimal actions and is always smaller than the covering dimension used in previous analyses. As such, our results are the first provably adaptive guarantees for reinforcement learning in metric spaces.
Submission history
From: Akshay Krishnamurthy [view email][v1] Thu, 18 Jun 2020 22:28:03 GMT (21kb,D)
[v2] Wed, 20 Oct 2021 14:14:17 GMT (230kb,D)
Link back to: arXiv, form interface, contact.