We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Robust nonparametric nearest neighbor random process clustering

Abstract: We consider the problem of clustering noisy finite-length observations of stationary ergodic random processes according to their generative models without prior knowledge of the model statistics and the number of generative models. Two algorithms, both using the $L^1$-distance between estimated power spectral densities (PSDs) as a measure of dissimilarity, are analyzed. The first one, termed nearest neighbor process clustering (NNPC), relies on partitioning the nearest neighbor graph of the observations via spectral clustering. The second algorithm, simply referred to as $k$-means (KM), consists of a single $k$-means iteration with farthest point initialization and was considered before in the literature, albeit with a different dissimilarity measure. We prove that both algorithms succeed with high probability in the presence of noise and missing entries, and even when the generative process PSDs overlap significantly, all provided that the observation length is sufficiently large. Our results quantify the tradeoff between the overlap of the generative process PSDs, the observation length, the fraction of missing entries, and the noise variance. Finally, we provide extensive numerical results for synthetic and real data and find that NNPC outperforms state-of-the-art algorithms in human motion sequence clustering.
Comments: 15 pages, 7 figures
Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)
Journal reference: IEEE Transactions on Signal Processing, Vol. 65, No. 22, pp. 6009-6023, Nov. 2017
DOI: 10.1109/TSP.2017.2736513
Cite as: arXiv:1612.01103 [cs.LG]
  (or arXiv:1612.01103v3 [cs.LG] for this version)

Submission history

From: Michael Tschannen [view email]
[v1] Sun, 4 Dec 2016 11:38:06 GMT (901kb,D)
[v2] Mon, 7 Aug 2017 16:11:31 GMT (314kb,D)
[v3] Thu, 28 Sep 2017 05:27:08 GMT (314kb,D)

Link back to: arXiv, form interface, contact.