References & Citations
Computer Science > Machine Learning
Title: Large Margin Distribution Machine
(Submitted on 5 Nov 2013 (v1), last revised 23 May 2014 (this version, v2))
Abstract: Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Recent theoretical results, however, disclosed that maximizing the minimum margin does not necessarily lead to better generalization performances, and instead, the margin distribution has been proven to be more crucial. In this paper, we propose the Large margin Distribution Machine (LDM), which tries to achieve a better generalization performance by optimizing the margin distribution. We characterize the margin distribution by the first- and second-order statistics, i.e., the margin mean and variance. The LDM is a general learning approach which can be used in any place where SVM can be applied, and its superiority is verified both theoretically and empirically in this paper.
Submission history
From: Zhi-Hua Zhou [view email][v1] Tue, 5 Nov 2013 08:46:26 GMT (204kb,D)
[v2] Fri, 23 May 2014 12:02:06 GMT (989kb)
Link back to: arXiv, form interface, contact.