References & Citations
Statistics > Machine Learning
Title: "I know it when I see it". Visualization and Intuitive Interpretability
(Submitted on 20 Nov 2017 (v1), last revised 6 Dec 2017 (this version, v2))
Abstract: Most research on the interpretability of machine learning systems focuses on the development of a more rigorous notion of interpretability. I suggest that a better understanding of the deficiencies of the intuitive notion of interpretability is needed as well. I show that visualization enables but also impedes intuitive interpretability, as it presupposes two levels of technical pre-interpretation: dimensionality reduction and regularization. Furthermore, I argue that the use of positive concepts to emulate the distributed semantic structure of machine learning models introduces a significant human bias into the model. As a consequence, I suggest that, if intuitive interpretability is needed, singular representations of internal model states should be avoided.
Submission history
From: Fabian Offert [view email][v1] Mon, 20 Nov 2017 05:25:06 GMT (10kb)
[v2] Wed, 6 Dec 2017 23:46:01 GMT (10kb)
Link back to: arXiv, form interface, contact.