We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

econ.EM

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Economics > Econometrics

Title: Reinforcing RCTs with Multiple Priors while Learning about External Validity

Abstract: This paper presents a framework for how to incorporate prior sources of information into the design of a sequential experiment. These sources can include previous experiments, expert opinions, or the experimenter's own introspection. We formalize this problem using a multi-prior Bayesian approach that maps each source to a Bayesian model. These models are aggregated according to their associated posterior probabilities. We evaluate a broad of policy rules according to three criteria: whether the experimenter learns the parameters of the payoff distributions, the probability that the experimenter chooses the wrong treatment when deciding to stop the experiment, and the average rewards. We show that our framework exhibits several nice finite sample properties, including robustness to any source that is not externally valid.
Subjects: Econometrics (econ.EM); Statistics Theory (math.ST); Methodology (stat.ME)
Cite as: arXiv:2112.09170 [econ.EM]
  (or arXiv:2112.09170v3 [econ.EM] for this version)

Submission history

From: Demian Pouzo [view email]
[v1] Thu, 16 Dec 2021 19:38:09 GMT (544kb,D)
[v2] Tue, 8 Feb 2022 16:51:14 GMT (560kb,D)
[v3] Sun, 15 May 2022 22:11:20 GMT (581kb,D)

Link back to: arXiv, form interface, contact.