We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Performance of a Distributed Stochastic Approximation Algorithm

Abstract: In this paper, a distributed stochastic approximation algorithm is studied. Applications of such algorithms include decentralized estimation, optimization, control or computing. The algorithm consists in two steps: a local step, where each node in a network updates a local estimate using a stochastic approximation algorithm with decreasing step size, and a gossip step, where a node computes a local weighted average between its estimates and those of its neighbors. Convergence of the estimates toward a consensus is established under weak assumptions. The approach relies on two main ingredients: the existence of a Lyapunov function for the mean field in the agreement subspace, and a contraction property of the random matrices of weights in the subspace orthogonal to the agreement subspace. A second order analysis of the algorithm is also performed under the form of a Central Limit Theorem. The Polyak-averaged version of the algorithm is also considered.
Comments: IEEE Transactions on Information Theory 2013
Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)
Cite as: arXiv:1203.1505 [math.OC]
  (or arXiv:1203.1505v2 [math.OC] for this version)

Submission history

From: Pascal Bianchi [view email]
[v1] Wed, 7 Mar 2012 15:44:31 GMT (129kb,D)
[v2] Mon, 2 Dec 2013 20:53:04 GMT (122kb,D)

Link back to: arXiv, form interface, contact.