We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Inferring feature importance with uncertainties in high-dimensional data

Abstract: Estimating feature importance is a significant aspect of explaining data-based models. Besides explaining the model itself, an equally relevant question is which features are important in the underlying data generating process. We present a Shapley value based framework for inferring the importance of individual features, including uncertainty in the estimator. We build upon the recently published feature importance measure of SAGE (Shapley additive global importance) and introduce sub-SAGE which can be estimated without resampling for tree-based models. We argue that the uncertainties can be estimated from bootstrapping and demonstrate the approach for tree ensemble methods. The framework is exemplified on synthetic data as well as high-dimensional genomics data.
Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2109.00855 [cs.LG]
  (or arXiv:2109.00855v3 [cs.LG] for this version)

Submission history

From: Inga Strümke [view email]
[v1] Thu, 2 Sep 2021 11:57:34 GMT (237kb,D)
[v2] Mon, 6 Sep 2021 07:24:58 GMT (236kb,D)
[v3] Mon, 20 Sep 2021 06:52:11 GMT (241kb,D)

Link back to: arXiv, form interface, contact.