Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectors
(Submitted on 27 Jun 2020 (v1), last revised 17 Jun 2021 (this version, v4))
Abstract: Convolutional neural network (CNN) models for computer vision are powerful but lack explainability in their most basic form. This deficiency remains a key challenge when applying CNNs in important domains. Recent work on explanations through feature importance of approximate linear models has moved from input-level features (pixels or segments) to features from mid-layer feature maps in the form of concept activation vectors (CAVs). CAVs contain concept-level information and could be learned via clustering. In this work, we rethink the ACE algorithm of Ghorbani et~al., proposing an alternative invertible concept-based explanation (ICE) framework to overcome its shortcomings. Based on the requirements of fidelity (approximate models to target models) and interpretability (being meaningful to people), we design measurements and evaluate a range of matrix factorization methods with our framework. We find that non-negative concept activation vectors (NCAVs) from non-negative matrix factorization provide superior performance in interpretability and fidelity based on computational and human subject experiments. Our framework provides both local and global concept-level explanations for pre-trained CNN models.
Submission history
From: Ruihan Zhang [view email][v1] Sat, 27 Jun 2020 17:57:26 GMT (1115kb,D)
[v2] Tue, 7 Jul 2020 10:13:10 GMT (1115kb,D)
[v3] Thu, 4 Feb 2021 13:54:53 GMT (1194kb,D)
[v4] Thu, 17 Jun 2021 12:31:21 GMT (6398kb,D)
Link back to: arXiv, form interface, contact.