References & Citations
Mathematics > Optimization and Control
Title: Accelerated Zeroth-order Algorithm for Stochastic Distributed Nonconvex Optimization
(Submitted on 7 Sep 2021 (v1), last revised 13 Oct 2021 (this version, v2))
Abstract: This paper investigates how to accelerate the convergence of distributed optimization algorithms on nonconvex problems with zeroth-order information available only. We propose a zeroth-order (ZO) distributed primal-dual stochastic coordinates algorithm equipped with "powerball" method to accelerate. We prove that the proposed algorithm has a convergence rate of $\mathcal{O}(\sqrt{p}/\sqrt{nT})$ for general nonconvex cost functions. We consider solving the generation of adversarial examples from black-box DNNs problem to compare with the existing state-of-the-art centralized and distributed ZO algorithms. The numerical results demonstrate the faster convergence rate of the proposed algorithm and match the theoretical analysis.
Submission history
From: Shengjun Zhang [view email][v1] Tue, 7 Sep 2021 17:54:18 GMT (3387kb,D)
[v2] Wed, 13 Oct 2021 21:49:13 GMT (3392kb,D)
Link back to: arXiv, form interface, contact.