We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Decentralized Personalized Federated Min-Max Problems

Abstract: Personalized Federated Learning (PFL) has recently seen tremendous progress, allowing the design of novel machine learning applications to preserve the privacy of the training data. Existing theoretical results in this field mainly focus on distributed optimization for minimization problems. This paper is the first to study PFL for saddle point problems (which cover a broader class of optimization problems), allowing for a more rich class of applications requiring more than just solving minimization problems. In this work, we consider a recently proposed PFL setting with the mixing objective function, an approach combining the learning of a global model together with locally distributed learners. Unlike most previous work, which considered only the centralized setting, we work in a more general and decentralized setup that allows us to design and analyze more practical and federated ways to connect devices to the network. We proposed new algorithms to address this problem and provide a theoretical analysis of the smooth (strongly-)convex-(strongly-)concave saddle point problems in stochastic and deterministic cases. Numerical experiments for bilinear problems and neural networks with adversarial noise demonstrate the effectiveness of the proposed methods.
Comments: New in v4: non-monotone analysis
Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)
Cite as: arXiv:2106.07289 [cs.LG]
  (or arXiv:2106.07289v4 [cs.LG] for this version)

Submission history

From: Aleksandr Beznosikov [view email]
[v1] Mon, 14 Jun 2021 10:36:25 GMT (2792kb,D)
[v2] Sun, 24 Oct 2021 11:01:47 GMT (6776kb,D)
[v3] Mon, 1 Nov 2021 11:43:47 GMT (6777kb,D)
[v4] Tue, 1 Feb 2022 16:56:51 GMT (6695kb,D)

Link back to: arXiv, form interface, contact.