We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Decentralized Gradient Methods with Time-varying Uncoordinated Stepsizes: Convergence Analysis and Privacy Design

Abstract: Decentralized optimization enables a network of agents to cooperatively optimize an overall objective function without a central coordinator and is gaining increased attention in domains as diverse as control, sensor networks, data mining, and robotics. However, the information sharing among agents in decentralized optimization also discloses agents' information, which is undesirable or even unacceptable when involved data are sensitive. This paper proposes two gradient based decentralized optimization algorithms that can protect participating agents' privacy without compromising optimization accuracy or incurring heavy communication/computational overhead. This is in distinct difference from differential privacy based approaches which have to trade optimization accuracy for privacy, or encryption based approaches which incur heavy communication and computational overhead. Both algorithms leverage a judiciously designed mixing matrix and time-varying uncoordinated stepsizes to enable privacy, one using diminishing stepsizes while the other using non-diminishing stepsizes. Both algorithms only require a participating agent to share one message with a neighboring agent in each iteration to reach convergence to an exact optimal solution, which is in contrast to most gradient-tracking based algorithms requiring every agent to share two messages (an optimization variable and an auxiliary gradient-tracking variable) under non-diminishing stepsizes. Furthermore, both algorithms can guarantee the privacy of a participating agent even when all information shared by the agent are accessible to an adversary, a scenario in which most existing accuracy-maintaining privacy approaches will fail to protect privacy. Simulation results confirm the effectiveness of the proposed algorithms.
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2205.10934 [math.OC]
  (or arXiv:2205.10934v1 [math.OC] for this version)

Submission history

From: Yongqiang Wang [view email]
[v1] Sun, 22 May 2022 21:21:36 GMT (88kb)

Link back to: arXiv, form interface, contact.