We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Applications

Title: Using public clinical trial reports to evaluate observational study methods

Abstract: Observational studies are valuable for estimating the effects of various medical interventions, but are notoriously difficult to evaluate because the methods used in observational studies require many untestable assumptions. This lack of verifiability makes it difficult both to compare different observational study methods and to trust the results of any particular observational study. In this work, we propose TrialVerify, a new approach for evaluating observational study methods based on ground truth sourced from clinical trial reports. We process trial reports into a denoised collection of known causal relationships that can then be used to estimate the precision and recall of various observational study methods. We then use TrialVerify to evaluate multiple observational study methods in terms of their ability to identify the known causal relationships from a large national insurance claims dataset. We found that inverse propensity score weighting is an effective approach for accurately reproducing known causal relationships and outperforms other observational study methods. TrialVerify is made freely available for others to evaluate observational study methods.
Subjects: Applications (stat.AP)
Cite as: arXiv:2006.14102 [stat.AP]
  (or arXiv:2006.14102v3 [stat.AP] for this version)

Submission history

From: Ethan Steinberg [view email]
[v1] Wed, 24 Jun 2020 23:38:32 GMT (183kb,D)
[v2] Tue, 1 Jun 2021 22:52:33 GMT (753kb)
[v3] Tue, 13 Sep 2022 16:32:58 GMT (787kb,D)

Link back to: arXiv, form interface, contact.