Current browse context:
stat.AP
Change to browse by:
References & Citations
Statistics > Applications
Title: Matching Bounds: How Choice of Matching Algorithm Impacts Treatment Effects Estimates and What to Do about It
(Submitted on 6 Sep 2020 (v1), last revised 22 Mar 2023 (this version, v3))
Abstract: Many major works in social science employ matching to make causal conclusions, but different matches on the same data may produce different treatment effect estimates, even when they achieve similar balance or minimize the same loss function. We discuss reasons and consequences of this problem. We present evidence of this problem by replicating ten papers that use matching and we find that different popular matching algorithms produce inconsistent results. We introduce Matching Bounds: a finite-sample, nonstochastic method that allows analysts to know whether a matched sample that produces different results with the same levels of balance and overall match quality could be obtained from their data. We apply Matching Bounds to a replication of two studies and show that in one case results are robust to this issue and in another they are not.
Submission history
From: Marco Morucci [view email][v1] Sun, 6 Sep 2020 17:03:30 GMT (1585kb,D)
[v2] Tue, 27 Oct 2020 23:35:26 GMT (1585kb,D)
[v3] Wed, 22 Mar 2023 15:17:05 GMT (1968kb,D)
Link back to: arXiv, form interface, contact.