Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Preconditioned Data Sparsification for Big Data with Applications to PCA and K-means
(Submitted on 31 Oct 2015 (v1), last revised 20 Sep 2016 (this version, v3))
Abstract: We analyze a compression scheme for large data sets that randomly keeps a small percentage of the components of each data sample. The benefit is that the output is a sparse matrix and therefore subsequent processing, such as PCA or K-means, is significantly faster, especially in a distributed-data setting. Furthermore, the sampling is single-pass and applicable to streaming data. The sampling mechanism is a variant of previous methods proposed in the literature combined with a randomized preconditioning to smooth the data. We provide guarantees for PCA in terms of the covariance matrix, and guarantees for K-means in terms of the error in the center estimators at a given step. We present numerical evidence to show both that our bounds are nearly tight and that our algorithms provide a real benefit when applied to standard test data sets, as well as providing certain benefits over related sampling approaches.
Submission history
From: Farhad Pourkamali-Anaraki [view email][v1] Sat, 31 Oct 2015 17:20:00 GMT (173kb,D)
[v2] Mon, 30 Nov 2015 22:40:13 GMT (206kb,D)
[v3] Tue, 20 Sep 2016 00:35:14 GMT (195kb,D)
Link back to: arXiv, form interface, contact.