We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: A Lower Bound for the Sample Complexity of Inverse Reinforcement Learning

Abstract: Inverse reinforcement learning (IRL) is the task of finding a reward function that generates a desired optimal policy for a given Markov Decision Process (MDP). This paper develops an information-theoretic lower bound for the sample complexity of the finite state, finite action IRL problem. A geometric construction of $\beta$-strict separable IRL problems using spherical codes is considered. Properties of the ensemble size as well as the Kullback-Leibler divergence between the generated trajectories are derived. The resulting ensemble is then used along with Fano's inequality to derive a sample complexity lower bound of $O(n \log n)$, where $n$ is the number of states in the MDP.
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Journal reference: International Conference on Machine Learning (ICML), 2021
Cite as: arXiv:2103.04446 [cs.LG]
  (or arXiv:2103.04446v1 [cs.LG] for this version)

Submission history

From: Abi Komanduru [view email]
[v1] Sun, 7 Mar 2021 20:29:10 GMT (133kb,D)

Link back to: arXiv, form interface, contact.