References & Citations
Computer Science > Machine Learning
Title: Incremental Permutation Feature Importance (iPFI): Towards Online Explanations on Data Streams
(Submitted on 5 Sep 2022 (v1), last revised 7 Sep 2022 (this version, v2))
Abstract: Explainable Artificial Intelligence (XAI) has mainly focused on static learning scenarios so far. We are interested in dynamic scenarios where data is sampled progressively, and learning is done in an incremental rather than a batch mode. We seek efficient incremental algorithms for computing feature importance (FI) measures, specifically, an incremental FI measure based on feature marginalization of absent features similar to permutation feature importance (PFI). We propose an efficient, model-agnostic algorithm called iPFI to estimate this measure incrementally and under dynamic modeling conditions including concept drift. We prove theoretical guarantees on the approximation quality in terms of expectation and variance. To validate our theoretical findings and the efficacy of our approaches compared to traditional batch PFI, we conduct multiple experimental studies on benchmark data with and without concept drift.
Submission history
From: Maximilian Muschalik [view email][v1] Mon, 5 Sep 2022 12:34:27 GMT (8362kb,D)
[v2] Wed, 7 Sep 2022 12:22:54 GMT (8362kb,D)
Link back to: arXiv, form interface, contact.