Current browse context:
cs.AI
Change to browse by:
References & Citations
Computer Science > Artificial Intelligence
Title: Problems with Shapley-value-based explanations as feature importance measures
(Submitted on 25 Feb 2020 (v1), last revised 30 Jun 2020 (this version, v2))
Abstract: Game-theoretic formulations of feature importance have become popular as a way to "explain" machine learning models. These methods define a cooperative game between the features of a model and distribute influence among these input elements using some form of the game's unique Shapley values. Justification for these methods rests on two pillars: their desirable mathematical properties, and their applicability to specific motivations for explanations. We show that mathematical problems arise when Shapley values are used for feature importance and that the solutions to mitigate these necessarily induce further complexity, such as the need for causal reasoning. We also draw on additional literature to argue that Shapley values do not provide explanations which suit human-centric goals of explainability.
Submission history
From: I. Elizabeth Kumar [view email][v1] Tue, 25 Feb 2020 18:51:14 GMT (25kb,D)
[v2] Tue, 30 Jun 2020 14:38:36 GMT (407kb,D)
Link back to: arXiv, form interface, contact.