Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Shapley explainability on the data manifold
(Submitted on 1 Jun 2020 (v1), last revised 20 Dec 2021 (this version, v4))
Abstract: Explainability in AI is crucial for model development, compliance with regulation, and providing operational nuance to predictions. The Shapley framework for explainability attributes a model's predictions to its input features in a mathematically principled and model-agnostic way. However, general implementations of Shapley explainability make an untenable assumption: that the model's features are uncorrelated. In this work, we demonstrate unambiguous drawbacks of this assumption and develop two solutions to Shapley explainability that respect the data manifold. One solution, based on generative modelling, provides flexible access to data imputations; the other directly learns the Shapley value-function, providing performance and stability at the cost of flexibility. While "off-manifold" Shapley values can (i) give rise to incorrect explanations, (ii) hide implicit model dependence on sensitive attributes, and (iii) lead to unintelligible explanations in higher-dimensional data, on-manifold explainability overcomes these problems.
Submission history
From: Christopher Frye [view email][v1] Mon, 1 Jun 2020 21:20:04 GMT (1159kb,D)
[v2] Wed, 14 Oct 2020 20:31:25 GMT (1403kb,D)
[v3] Mon, 22 Feb 2021 17:09:23 GMT (1405kb,D)
[v4] Mon, 20 Dec 2021 17:43:52 GMT (1405kb,D)
Link back to: arXiv, form interface, contact.