Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Deep Over-sampling Framework for Classifying Imbalanced Data
(Submitted on 25 Apr 2017 (v1), last revised 12 Jul 2017 (this version, v3))
Abstract: Class imbalance is a challenging issue in practical classification problems for deep learning models as well as traditional models. Traditionally successful countermeasures such as synthetic over-sampling have had limited success with complex, structured data handled by deep learning models. In this paper, we propose Deep Over-sampling (DOS), a framework for extending the synthetic over-sampling method to exploit the deep feature space acquired by a convolutional neural network (CNN). Its key feature is an explicit, supervised representation learning, for which the training data presents each raw input sample with a synthetic embedding target in the deep feature space, which is sampled from the linear subspace of in-class neighbors. We implement an iterative process of training the CNN and updating the targets, which induces smaller in-class variance among the embeddings, to increase the discriminative power of the deep representation. We present an empirical study using public benchmarks, which shows that the DOS framework not only counteracts class imbalance better than the existing method, but also improves the performance of the CNN in the standard, balanced settings.
Submission history
From: Shin Ando Ph. D. [view email][v1] Tue, 25 Apr 2017 02:12:00 GMT (1726kb,D)
[v2] Wed, 5 Jul 2017 06:40:40 GMT (1726kb,D)
[v3] Wed, 12 Jul 2017 21:02:37 GMT (104kb,D)
Link back to: arXiv, form interface, contact.