Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Towards Out-of-Distribution Detection with Divergence Guarantee in Deep Generative Models
(Submitted on 9 Feb 2020 (v1), revised 16 Sep 2021 (this version, v4), latest version 2 Mar 2023 (v5))
Abstract: Recent research has revealed that deep generative models including flow-based models and Variational autoencoders may assign higher likelihood to out-of-distribution (OOD) data than in-distribution (ID) data. However, we cannot sample out OOD data from the model. This counterintuitive phenomenon has not been satisfactorily explained. In this paper, we prove theorems to investigate the divergences in flow-based model and give two explanations to the above phenomenon from divergence and geometric perspectives, respectively. Based on our analysis, we propose two group anomaly detection methods. Furthermore, we decompose the KL divergence and propose a point-wise anomaly detection method. We have conducted extensive experiments on prevalent benchmarks to evaluate our methods. For group anomaly detection (GAD), our method can achieve near 100\% AUROC on all problems and has robustness against data manipulations. On the contrary, the state-of-the-art (SOTA) GAD method performs not better than random guessing for challenging problems and can be attacked by data manipulation in almost all cases. For point-wise anomaly detection (PAD), our method is comparable to the SOTA PAD method on one category of problems and outperforms the baseline significantly on another category of problems.
Submission history
From: Yufeng Zhang [view email][v1] Sun, 9 Feb 2020 09:54:12 GMT (7931kb,D)
[v2] Sun, 12 Jul 2020 11:56:54 GMT (8791kb,D)
[v3] Fri, 5 Feb 2021 13:56:04 GMT (9939kb,D)
[v4] Thu, 16 Sep 2021 05:59:28 GMT (11150kb,D)
[v5] Thu, 2 Mar 2023 06:56:26 GMT (11521kb,D)
Link back to: arXiv, form interface, contact.