We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

q-bio.NC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Quantitative Biology > Neurons and Cognition

Title: Positioning is All You Need

Authors: Xin Li
Abstract: One can drive around safely using a GPS without memorizing a world map (not to mention the dark regions that humans have never explored) because we only pay attention to the next instruction of turning. Such simple observation with attention mechanism has a profound implication on our understanding of how the brain works. The nonlinear effects generated by inhibitory networks have long been known to provide a ``winner-take-all'' mechanism for localized attention. This attention mechanism, at the system level, implements the selection/positioning operation needed by the hippocampus to provide spatio-temporal context to the neocortex. The localized receptive field of sensory organs, when inspected under the framework of embodied cognition, turns from a constraint to an advantage. Since we only need access to a local map, positioning works better than reconstruction. Such simple intuition implies that the attention mechanism is all you need to understand the flexible behavior generated by hippocampal-neocortical systems. Geometrically, we present a novel manifold positioning framework to explain the principle of localized embodied cognition. Through the co-evolution of the hippocampus and the neocortex, the positioning operation implemented by the attention mechanism can be interpreted as a nonlinear projection linking the discovery of local subspace structure by the neocortex (a sensorimotor machine generating the world map) with the navigation task in mind and $without$ discovering global manifold topology by the hippocampus (the neocortex's map index).
Subjects: Neurons and Cognition (q-bio.NC); Adaptation and Self-Organizing Systems (nlin.AO)
Cite as: arXiv:2404.01183 [q-bio.NC]
  (or arXiv:2404.01183v1 [q-bio.NC] for this version)

Submission history

From: Xin Li [view email]
[v1] Mon, 1 Apr 2024 15:35:41 GMT (385kb,D)
[v2] Wed, 3 Apr 2024 17:32:32 GMT (384kb,D)

Link back to: arXiv, form interface, contact.