We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: A Decentralized Framework for Kernel PCA with Projection Consensus Constraints

Abstract: This paper studies kernel PCA in a decentralized setting, where data are distributively observed with full features in local nodes and a fusion center is prohibited. Compared with linear PCA, the use of kernel brings challenges to the design of decentralized consensus optimization: the local projection directions are data-dependent. As a result, the consensus constraint in distributed linear PCA is no longer valid. To overcome this problem, we propose a projection consensus constraint and obtain an effective decentralized consensus framework, where local solutions are expected to be the projection of the global solution on the column space of local dataset. We also derive a fully non-parametric, fast and convergent algorithm based on alternative direction method of multiplier, of which each iteration is analytic and communication-effcient. Experiments on a truly parallel architecture are conducted on real-world data, showing that the proposed decentralized algorithm is effective to utilize information of other nodes and takes great advantages in running time over the central kernel PCA.
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
Cite as: arXiv:2211.15953 [cs.DC]
  (or arXiv:2211.15953v1 [cs.DC] for this version)

Submission history

From: Fan He [view email]
[v1] Tue, 29 Nov 2022 06:26:39 GMT (1871kb,D)

Link back to: arXiv, form interface, contact.