We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Markov Chain Lifting and Distributed ADMM

Abstract: The time to converge to the steady state of a finite Markov chain can be greatly reduced by a lifting operation, which creates a new Markov chain on an expanded state space. For a class of quadratic objectives, we show an analogous behavior where a distributed ADMM algorithm can be seen as a lifting of Gradient Descent algorithm. This provides a deep insight for its faster convergence rate under optimal parameter tuning. We conjecture that this gain is always present, as opposed to the lifting of a Markov chain which sometimes only provides a marginal speedup.
Comments: This work was also selected for a talk at NIPS 2016, Optimization for Machine Learning Workshop (OPT 2016)
Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC)
Journal reference: IEEE Signal Processing Letters (Volume: 24, Issue: 3, March 2017)
DOI: 10.1109/LSP.2017.2654860
Cite as: arXiv:1703.03859 [stat.ML]
  (or arXiv:1703.03859v1 [stat.ML] for this version)

Submission history

From: Guilherme França [view email]
[v1] Fri, 10 Mar 2017 22:25:56 GMT (144kb,D)

Link back to: arXiv, form interface, contact.