We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Fast Incremental SVDD Learning Algorithm with the Gaussian Kernel

Abstract: Support vector data description (SVDD) is a machine learning technique that is used for single-class classification and outlier detection. The idea of SVDD is to find a set of support vectors that defines a boundary around data. When dealing with online or large data, existing batch SVDD methods have to be rerun in each iteration. We propose an incremental learning algorithm for SVDD that uses the Gaussian kernel. This algorithm builds on the observation that all support vectors on the boundary have the same distance to the center of sphere in a higher-dimensional feature space as mapped by the Gaussian kernel function. Each iteration involves only the existing support vectors and the new data point. Moreover, the algorithm is based solely on matrix manipulations; the support vectors and their corresponding Lagrange multiplier $\alpha_i$'s are automatically selected and determined in each iteration. It can be seen that the complexity of our algorithm in each iteration is only $O(k^2)$, where $k$ is the number of support vectors. Experimental results on some real data sets indicate that FISVDD demonstrates significant gains in efficiency with almost no loss in either outlier detection accuracy or objective function value.
Comments: 18 pages, 1 table, 4 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:1709.00139 [stat.ML]
  (or arXiv:1709.00139v4 [stat.ML] for this version)

Submission history

From: Hansi Jiang [view email]
[v1] Fri, 1 Sep 2017 02:47:05 GMT (29kb,D)
[v2] Tue, 16 Jan 2018 18:20:36 GMT (30kb,D)
[v3] Thu, 1 Feb 2018 23:37:31 GMT (48kb,D)
[v4] Thu, 1 Nov 2018 22:13:35 GMT (47kb,D)

Link back to: arXiv, form interface, contact.