We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Economics > Econometrics

Title: Policy Choice and Best Arm Identification: Asymptotic Analysis of Exploration Sampling

Abstract: We consider the "policy choice" problem -- otherwise known as best arm identification in the bandit literature -- proposed by Kasy and Sautmann (2021) for adaptive experimental design. Theorem 1 of Kasy and Sautmann (2021) provides three asymptotic results that give theoretical guarantees for exploration sampling developed for this setting. We first show that the proof of Theorem 1 (1) has technical issues, and the proof and statement of Theorem 1 (2) are incorrect. We then show, through a counterexample, that Theorem 1 (3) is false. For the former two, we correct the statements and provide rigorous proofs. For Theorem 1 (3), we propose an alternative objective function, which we call posterior weighted policy regret, and derive the asymptotic optimality of exploration sampling.
Comments: Submitted to Econometrica
Subjects: Econometrics (econ.EM); Machine Learning (cs.LG); Methodology (stat.ME)
Cite as: arXiv:2109.08229 [econ.EM]
  (or arXiv:2109.08229v5 [econ.EM] for this version)

Submission history

From: Masahiro Kato [view email]
[v1] Thu, 16 Sep 2021 21:27:03 GMT (27kb)
[v2] Tue, 12 Oct 2021 21:02:23 GMT (28kb)
[v3] Wed, 20 Oct 2021 17:40:50 GMT (24kb)
[v4] Sat, 20 Nov 2021 07:44:56 GMT (30kb)
[v5] Wed, 24 Nov 2021 10:10:34 GMT (30kb)

Link back to: arXiv, form interface, contact.