We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: MetaFed: Federated Learning among Federations with Cyclic Knowledge Distillation for Personalized Healthcare

Abstract: Federated learning has attracted increasing attention to building models without accessing the raw user data, especially in healthcare. In real applications, different federations can seldom work together due to possible reasons such as data heterogeneity and distrust/inexistence of the central server. In this paper, we propose a novel framework called MetaFed to facilitate trustworthy FL between different federations. MetaFed obtains a personalized model for each federation without a central server via the proposed Cyclic Knowledge Distillation. Specifically, MetaFed treats each federation as a meta distribution and aggregates knowledge of each federation in a cyclic manner. The training is split into two parts: common knowledge accumulation and personalization. Comprehensive experiments on three benchmarks demonstrate that MetaFed without a server achieves better accuracy compared to state-of-the-art methods (e.g., 10%+ accuracy improvement compared to the baseline for PAMAP2) with fewer communication costs.
Comments: Accepted by IJCAI'22 federated learning workshop; code at this https URL
Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY)
Cite as: arXiv:2206.08516 [cs.LG]
  (or arXiv:2206.08516v1 [cs.LG] for this version)

Submission history

From: Jindong Wang [view email]
[v1] Fri, 17 Jun 2022 02:36:23 GMT (293kb,D)

Link back to: arXiv, form interface, contact.