References & Citations
Computer Science > Machine Learning
Title: Lightweight Distributed Gaussian Process Regression for Online Machine Learning
(Submitted on 11 May 2021 (v1), last revised 10 Jul 2023 (this version, v5))
Abstract: In this paper, we study the problem where a group of agents aim to collaboratively learn a common static latent function through streaming data. We propose a lightweight distributed Gaussian process regression (GPR) algorithm that is cognizant of agents' limited capabilities in communication, computation and memory. Each agent independently runs agent-based GPR using local streaming data to predict test points of interest; then the agents collaboratively execute distributed GPR to obtain global predictions over a common sparse set of test points; finally, each agent fuses results from distributed GPR with agent-based GPR to refine its predictions. By quantifying the transient and steady-state performances in predictive variance and error, we show that limited inter-agent communication improves learning performances in the sense of Pareto. Monte Carlo simulation is conducted to evaluate the developed algorithm.
Submission history
From: Zhenyuan Yuan [view email][v1] Tue, 11 May 2021 01:13:22 GMT (5443kb,D)
[v2] Thu, 13 May 2021 23:08:21 GMT (5444kb,D)
[v3] Wed, 1 Dec 2021 03:49:48 GMT (5845kb,D)
[v4] Thu, 2 Dec 2021 04:52:06 GMT (5845kb,D)
[v5] Mon, 10 Jul 2023 03:26:38 GMT (6558kb,D)
Link back to: arXiv, form interface, contact.