Current browse context:
cs
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Distributed Banach-Picard Iteration: Application to Distributed EM and Distributed PCA
(Submitted on 20 Jun 2021 (v1), last revised 26 Jan 2022 (this version, v2))
Abstract: In recent work, we proposed a distributed Banach-Picard iteration (DBPI) that allows a set of agents, linked by a communication network, to find a fixed point of a locally contractive (LC) map that is the average of individual maps held by said agents. In this work, we build upon the DBPI and its local linear convergence (LLC) guarantees to make several contributions. We show that Sanger's algorithm for principal component analysis (PCA) corresponds to the iteration of an LC map that can be written as the average of local maps, each map known to each agent holding a subset of the data. Similarly, we show that a variant of the expectation-maximization (EM) algorithm for parameter estimation from noisy and faulty measurements in a sensor network can be written as the iteration of an LC map that is the average of local maps, each available at just one node. Consequently, via the DBPI, we derive two distributed algorithms - distributed EM and distributed PCA - whose LLC guarantees follow from those that we proved for the DBPI. The verification of the LC condition for EM is challenging, as the underlying operator depends on random samples, thus the LC condition is of probabilistic nature.
Submission history
From: Mario Figueiredo [view email][v1] Sun, 20 Jun 2021 09:46:36 GMT (136kb,D)
[v2] Wed, 26 Jan 2022 16:44:27 GMT (139kb,D)
Link back to: arXiv, form interface, contact.