Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: ECLAD: Extracting Concepts with Local Aggregated Descriptors
(Submitted on 9 Jun 2022 (v1), last revised 11 Aug 2023 (this version, v3))
Abstract: Convolutional neural networks (CNNs) are increasingly being used in critical systems, where robustness and alignment are crucial. In this context, the field of explainable artificial intelligence has proposed the generation of high-level explanations of the prediction process of CNNs through concept extraction. While these methods can detect whether or not a concept is present in an image, they are unable to determine its location. What is more, a fair comparison of such approaches is difficult due to a lack of proper validation procedures. To address these issues, we propose a novel method for automatic concept extraction and localization based on representations obtained through pixel-wise aggregations of CNN activation maps. Further, we introduce a process for the validation of concept-extraction techniques based on synthetic datasets with pixel-wise annotations of their main components, reducing the need for human intervention. Extensive experimentation on both synthetic and real-world datasets demonstrates that our method outperforms state-of-the-art alternatives.
Submission history
From: Andres Felipe Posada Moreno [view email][v1] Thu, 9 Jun 2022 14:25:23 GMT (29567kb,D)
[v2] Wed, 12 Oct 2022 16:32:06 GMT (29743kb,D)
[v3] Fri, 11 Aug 2023 09:11:59 GMT (15737kb,D)
Link back to: arXiv, form interface, contact.