Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Deep Residual Flow for Out of Distribution Detection
(Submitted on 15 Jan 2020 (v1), last revised 19 Jul 2020 (this version, v3))
Abstract: The effective application of neural networks in the real-world relies on proficiently detecting out-of-distribution examples. Contemporary methods seek to model the distribution of feature activations in the training data for adequately distinguishing abnormalities, and the state-of-the-art method uses Gaussian distribution models. In this work, we present a novel approach that improves upon the state-of-the-art by leveraging an expressive density model based on normalizing flows. We introduce the residual flow, a novel flow architecture that learns the residual distribution from a base Gaussian distribution. Our model is general, and can be applied to any data that is approximately Gaussian. For out of distribution detection in image datasets, our approach provides a principled improvement over the state-of-the-art. Specifically, we demonstrate the effectiveness of our method in ResNet and DenseNet architectures trained on various image datasets. For example, on a ResNet trained on CIFAR-100 and evaluated on detection of out-of-distribution samples from the ImageNet dataset, holding the true positive rate (TPR) at $95\%$, we improve the true negative rate (TNR) from $56.7\%$ (current state-of-the-art) to $77.5\%$ (ours).
Submission history
From: Ev Zisselman [view email][v1] Wed, 15 Jan 2020 16:38:47 GMT (220kb,D)
[v2] Fri, 27 Mar 2020 16:20:47 GMT (592kb,D)
[v3] Sun, 19 Jul 2020 17:44:12 GMT (592kb,D)
Link back to: arXiv, form interface, contact.