We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.AP

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Applications

Title: Causality-based tests to detect the influence of confounders on mobile health diagnostic applications: a comparison with restricted permutations

Abstract: Machine learning practice is often impacted by confounders. Confounding can be particularly severe in remote digital health studies where the participants self-select to enter the study. While many different confounding adjustment approaches have been proposed in the literature, most of these methods rely on modeling assumptions, and it is unclear how robust they are to violations of these assumptions. This realization has recently motivated the development of restricted permutation methods to quantify the influence of observed confounders on the predictive performance of a machine learning models and evaluate if confounding adjustment methods are working as expected. In this paper we show, nonetheless, that restricted permutations can generate biased estimates of the contribution of the confounders to the predictive performance of a learner, and we propose an alternative approach to tackle this problem. By viewing a classification task from a causality perspective, we are able to leverage conditional independence tests between predictions and test set labels and confounders in order to detect confounding on the predictive performance of a classifier. We illustrate the application of our causality-based approach to data collected from mHealth study in Parkinson's disease.
Comments: Machine Learning for Health (ML4H) at NeurIPS 2019 - Extended Abstract
Subjects: Applications (stat.AP)
Cite as: arXiv:1911.05139 [stat.AP]
  (or arXiv:1911.05139v1 [stat.AP] for this version)

Submission history

From: Elias Chaibub Neto [view email]
[v1] Tue, 12 Nov 2019 20:56:30 GMT (104kb,D)

Link back to: arXiv, form interface, contact.