We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

q-bio.NC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Quantitative Biology > Neurons and Cognition

Title: A biologically plausible neural network for multi-channel Canonical Correlation Analysis

Abstract: Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement Canonical Correlation Analysis (CCA), an unsupervised learning method that projects the inputs onto a common subspace so as to maximize the correlations between the projections. To this end, we seek a multi-channel CCA algorithm that can be implemented in a biologically plausible neural network. For biological plausibility, we require that the network operates in the online setting and its synaptic update rules are local. Starting from a novel CCA objective function, we derive an online optimization algorithm whose optimization steps can be implemented in a single-layer neural network with multi-compartmental neurons and local non-Hebbian learning rules. We also derive an extension of our online CCA algorithm with adaptive output rank and output whitening. Interestingly, the extension maps onto a neural network whose neural architecture and synaptic updates resemble neural circuitry and synaptic plasticity observed experimentally in cortical pyramidal neurons.
Comments: 46 pages, 14 figures
Subjects: Neurons and Cognition (q-bio.NC); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)
Cite as: arXiv:2010.00525 [q-bio.NC]
  (or arXiv:2010.00525v4 [q-bio.NC] for this version)

Submission history

From: David Lipshutz [view email]
[v1] Thu, 1 Oct 2020 16:17:53 GMT (3462kb,D)
[v2] Fri, 13 Nov 2020 22:27:18 GMT (3455kb,D)
[v3] Thu, 11 Mar 2021 16:52:07 GMT (7810kb,D)
[v4] Fri, 26 Mar 2021 16:18:09 GMT (7812kb,D)

Link back to: arXiv, form interface, contact.