Current browse context:
econ.EM
Change to browse by:
References & Citations
Economics > Econometrics
Title: Self-fulfilling Bandits: Dynamic Selection in Algorithmic Decision-making
(Submitted on 28 Aug 2021 (v1), revised 19 Oct 2021 (this version, v2), latest version 28 Sep 2023 (v3))
Abstract: This paper identifies and addresses dynamic selection problems that arise in online learning algorithms with endogenous data. In a contextual multi-armed bandit model, we show that a novel bias (self-fulfilling bias) arises because the endogeneity of the data influences the choices of decisions, affecting the distribution of future data to be collected and analyzed. We propose a class of algorithms to correct for the bias by incorporating instrumental variables into leading online learning algorithms. These algorithms lead to the true parameter values and meanwhile attain low (logarithmic-like) regret levels. We further prove a central limit theorem for statistical inference of the parameters of interest. To establish the theoretical properties, we develop a general technique that untangles the interdependence between data and actions.
Submission history
From: Xiaowei Zhang [view email][v1] Sat, 28 Aug 2021 01:41:37 GMT (1975kb,D)
[v2] Tue, 19 Oct 2021 12:29:28 GMT (3950kb,D)
[v3] Thu, 28 Sep 2023 01:21:27 GMT (1623kb,D)
Link back to: arXiv, form interface, contact.