Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instances
(Submitted on 16 Jul 2020 (v1), last revised 21 Oct 2020 (this version, v2))
Abstract: Novelty detection, i.e., identifying whether a given sample is drawn from outside the training distribution, is essential for reliable machine learning. To this end, there have been many attempts at learning a representation well-suited for novelty detection and designing a score based on such representation. In this paper, we propose a simple, yet effective method named contrasting shifted instances (CSI), inspired by the recent success on contrastive learning of visual representations. Specifically, in addition to contrasting a given sample with other instances as in conventional contrastive learning methods, our training scheme contrasts the sample with distributionally-shifted augmentations of itself. Based on this, we propose a new detection score that is specific to the proposed training scheme. Our experiments demonstrate the superiority of our method under various novelty detection scenarios, including unlabeled one-class, unlabeled multi-class and labeled multi-class settings, with various image benchmark datasets. Code and pre-trained models are available at this https URL
Submission history
From: Sangwoo Mo [view email][v1] Thu, 16 Jul 2020 08:32:56 GMT (4057kb,D)
[v2] Wed, 21 Oct 2020 08:09:43 GMT (3326kb,D)
Link back to: arXiv, form interface, contact.