We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Distributed Kernel K-Means for Large Scale Clustering

Abstract: Clustering samples according to an effective metric and/or vector space representation is a challenging unsupervised learning task with a wide spectrum of applications. Among several clustering algorithms, k-means and its kernelized version have still a wide audience because of their conceptual simplicity and efficacy. However, the systematic application of the kernelized version of k-means is hampered by its inherent square scaling in memory with the number of samples. In this contribution, we devise an approximate strategy to minimize the kernel k-means cost function in which the trade-off between accuracy and velocity is automatically ruled by the available system memory. Moreover, we define an ad-hoc parallelization scheme well suited for hybrid cpu-gpu state-of-the-art parallel architectures. We proved the effectiveness both of the approximation scheme and of the parallelization method on standard UCI datasets and on molecular dynamics (MD) data in the realm of computational chemistry. In this applicative domain, clustering can play a key role for both quantitively estimating kinetics rates via Markov State Models or to give qualitatively a human compatible summarization of the underlying chemical phenomenon under study. For these reasons, we selected it as a valuable real-world application scenario.
Comments: Conference paper
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)
Journal reference: 3rd International Conference on Artificial Intelligence and Soft Computing, Computer Science & Information Technology, AIRCC, Vol 7, Number 10, August 2017
DOI: 10.5121/csit.2017.71015
Cite as: arXiv:1710.03013 [cs.DC]
  (or arXiv:1710.03013v1 [cs.DC] for this version)

Submission history

From: Marco Jacopo Ferrarotti [view email]
[v1] Mon, 9 Oct 2017 09:55:24 GMT (1145kb)

Link back to: arXiv, form interface, contact.