Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Explaining Neural Networks by Decoding Layer Activations
(Submitted on 27 May 2020 (v1), last revised 26 Feb 2021 (this version, v3))
Abstract: We present a `CLAssifier-DECoder' architecture (\emph{ClaDec}) which facilitates the comprehension of the output of an arbitrary layer in a neural network (NN). It uses a decoder to transform the non-interpretable representation of the given layer to a representation that is more similar to the domain a human is familiar with. In an image recognition problem, one can recognize what information is represented by a layer by contrasting reconstructed images of \emph{ClaDec} with those of a conventional auto-encoder(AE) serving as reference. We also extend \emph{ClaDec} to allow the trade-off between human interpretability and fidelity. We evaluate our approach for image classification using Convolutional NNs. We show that reconstructed visualizations using encodings from a classifier capture more relevant information for classification than conventional AEs. Relevant code is available at \url{this https URL}
Submission history
From: Johannes Schneider [view email][v1] Wed, 27 May 2020 20:22:10 GMT (7464kb,D)
[v2] Sat, 19 Sep 2020 16:35:52 GMT (9413kb,D)
[v3] Fri, 26 Feb 2021 17:11:43 GMT (12011kb,D)
Link back to: arXiv, form interface, contact.