We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Communication-Efficient Distributed Statistical Inference

Abstract: We present a Communication-efficient Surrogate Likelihood (CSL) framework for solving distributed statistical inference problems. CSL provides a communication-efficient surrogate to the global likelihood that can be used for low-dimensional estimation, high-dimensional regularized estimation and Bayesian inference. For low-dimensional estimation, CSL provably improves upon naive averaging schemes and facilitates the construction of confidence intervals. For high-dimensional regularized estimation, CSL leads to a minimax-optimal estimator with controlled communication cost. For Bayesian inference, CSL can be used to form a communication-efficient quasi-posterior distribution that converges to the true posterior. This quasi-posterior procedure significantly improves the computational efficiency of MCMC algorithms even in a non-distributed setting. We present both theoretical analysis and experiments to explore the properties of the CSL approximation.
Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC); Methodology (stat.ME)
Cite as: arXiv:1605.07689 [stat.ML]
  (or arXiv:1605.07689v3 [stat.ML] for this version)

Submission history

From: Jason Lee [view email]
[v1] Wed, 25 May 2016 00:12:06 GMT (246kb)
[v2] Thu, 3 Nov 2016 05:31:41 GMT (248kb)
[v3] Sun, 6 Nov 2016 00:37:39 GMT (248kb)

Link back to: arXiv, form interface, contact.