We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead

Authors: Cynthia Rudin
Abstract: Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to \textit{explain} black box models, rather than creating models that are \textit{interpretable} in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward -- it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.
Comments: Author's pre-publication version of a 2019 Nature Machine Intelligence article. Shorter Version was published in NIPS 2018 Workshop on Critiquing and Correcting Trends in Machine Learning. Expands also on NSF Statistics at a Crossroads Webinar
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Journal reference: Nature Machine Intelligence, Vol 1, May 2019, 206-215
Cite as: arXiv:1811.10154 [stat.ML]
  (or arXiv:1811.10154v3 [stat.ML] for this version)

Submission history

From: Cynthia Rudin [view email]
[v1] Mon, 26 Nov 2018 03:00:25 GMT (2019kb,D)
[v2] Wed, 5 Dec 2018 04:09:42 GMT (2024kb,D)
[v3] Sun, 22 Sep 2019 03:05:09 GMT (1087kb,D)

Link back to: arXiv, form interface, contact.