We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Necessary and Sufficient Conditions for Inverse Reinforcement Learning of Bayesian Stopping Time Problems

Abstract: This paper presents an inverse reinforcement learning (IRL) framework for Bayesian stopping time problems. By observing the actions of a Bayesian decision maker, we provide a necessary and sufficient condition to identify if these actions are consistent with optimizing a cost function; then we construct set valued estimates of the cost function. To achieve this IRL objective, we use novel ideas from Bayesian revealed preferences stemming from microeconomics. To illustrate our IRL scheme,we consider two important examples of stopping time problems, namely, sequential hypothesis testing and Bayesian search. Finally, for finite datasets, we propose an IRL detection algorithm and give finite sample bounds on its error probabilities. Also we discuss how to identify $\epsilon$-optimal Bayesian decision makers and perform IRL.
Subjects: Machine Learning (cs.LG); Theoretical Economics (econ.TH); Systems and Control (eess.SY); Machine Learning (stat.ML)
Cite as: arXiv:2007.03481 [cs.LG]
  (or arXiv:2007.03481v2 [cs.LG] for this version)

Submission history

From: Vikram Krishnamurthy [view email]
[v1] Tue, 7 Jul 2020 14:14:12 GMT (768kb,D)
[v2] Sun, 25 Oct 2020 00:40:40 GMT (1437kb,D)

Link back to: arXiv, form interface, contact.