Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Evaluation of Similarity-based Explanations
(Submitted on 8 Jun 2020 (v1), last revised 22 Mar 2021 (this version, v2))
Abstract: Explaining the predictions made by complex machine learning models helps users to understand and accept the predicted outputs with confidence. One promising way is to use similarity-based explanation that provides similar instances as evidence to support model predictions. Several relevance metrics are used for this purpose. In this study, we investigated relevance metrics that can provide reasonable explanations to users. Specifically, we adopted three tests to evaluate whether the relevance metrics satisfy the minimal requirements for similarity-based explanation. Our experiments revealed that the cosine similarity of the gradients of the loss performs best, which would be a recommended choice in practice. In addition, we showed that some metrics perform poorly in our tests and analyzed the reasons of their failure. We expect our insights to help practitioners in selecting appropriate relevance metrics and also aid further researches for designing better relevance metrics for explanations.
Submission history
From: Kazuaki Hanawa [view email][v1] Mon, 8 Jun 2020 12:39:46 GMT (519kb,D)
[v2] Mon, 22 Mar 2021 22:15:53 GMT (931kb,D)
Link back to: arXiv, form interface, contact.