Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Contrastive Similarity Matching for Supervised Learning
(Submitted on 24 Feb 2020 (v1), last revised 6 Dec 2020 (this version, v5))
Abstract: We propose a novel biologically-plausible solution to the credit assignment problem motivated by observations in the ventral visual pathway and trained deep neural networks. In both, representations of objects in the same category become progressively more similar, while objects belonging to different categories become less similar. We use this observation to motivate a layer-specific learning goal in a deep network: each layer aims to learn a representational similarity matrix that interpolates between previous and later layers. We formulate this idea using a contrastive similarity matching objective function and derive from it deep neural networks with feedforward, lateral, and feedback connections, and neurons that exhibit biologically-plausible Hebbian and anti-Hebbian plasticity. Contrastive similarity matching can be interpreted as an energy-based learning algorithm, but with significant differences from others in how a contrastive function is constructed.
Submission history
From: Shanshan Qin [view email][v1] Mon, 24 Feb 2020 17:10:21 GMT (7099kb,D)
[v2] Tue, 10 Mar 2020 02:48:47 GMT (14232kb,D)
[v3] Mon, 3 Aug 2020 16:56:36 GMT (2802kb,D)
[v4] Mon, 17 Aug 2020 14:21:49 GMT (2802kb,D)
[v5] Sun, 6 Dec 2020 02:09:28 GMT (3709kb,D)
Link back to: arXiv, form interface, contact.