References & Citations
Computer Science > Machine Learning
Title: Fault-Tolerant Federated Reinforcement Learning with Theoretical Guarantee
(Submitted on 26 Oct 2021 (v1), last revised 3 Nov 2022 (this version, v2))
Abstract: The growing literature of Federated Learning (FL) has recently inspired Federated Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better decision-making policy without sharing raw trajectories. Despite its promising applications, existing works on FRL fail to I) provide theoretical analysis on its convergence, and II) account for random system failures and adversarial attacks. Towards this end, we propose the first FRL framework the convergence of which is guaranteed and tolerant to less than half of the participating agents being random system failures or adversarial attackers. We prove that the sample efficiency of the proposed framework is guaranteed to improve with the number of agents and is able to account for such potential failures or attacks. All theoretical results are empirically verified on various RL benchmark tasks.
Submission history
From: Flint Xiaofeng Fan [view email][v1] Tue, 26 Oct 2021 23:01:22 GMT (10660kb,D)
[v2] Thu, 3 Nov 2022 17:42:01 GMT (5793kb,D)
Link back to: arXiv, form interface, contact.