We gratefully acknowledge support from
the Simons Foundation and member institutions.

Neurons and Cognition

New submissions

[ total of 9 entries: 1-9 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Tue, 20 Apr 21

[1]  arXiv:2104.08537 [pdf, other]
Title: Emergence of Lie symmetries in functional architectures learned by CNNs
Subjects: Neurons and Cognition (q-bio.NC); Neural and Evolutionary Computing (cs.NE)

In this paper we study the spontaneous development of symmetries in the early layers of a Convolutional Neural Network (CNN) during learning on natural images. Our architecture is built in such a way to mimic the early stages of biological visual systems. In particular, it contains a pre-filtering step $\ell^0$ defined in analogy with the Lateral Geniculate Nucleus (LGN). Moreover, the first convolutional layer is equipped with lateral connections defined as a propagation driven by a learned connectivity kernel, in analogy with the horizontal connectivity of the primary visual cortex (V1). The layer $\ell^0$ shows a rotational symmetric pattern well approximated by a Laplacian of Gaussian (LoG), which is a well-known model of the receptive profiles of LGN cells. The convolutional filters in the first layer can be approximated by Gabor functions, in agreement with well-established models for the profiles of simple cells in V1. We study the learned lateral connectivity kernel of this layer, showing the emergence of orientation selectivity w.r.t. the learned filters. We also examine the association fields induced by the learned kernel, and show qualitative and quantitative comparisons with known group-based models of V1 horizontal connectivity. These geometric properties arise spontaneously during the training of the CNN architecture, analogously to the emergence of symmetries in visual systems thanks to brain plasticity driven by external stimuli.

[2]  arXiv:2104.09188 [pdf, other]
Title: A devil's advocate view on 'self-organized' brain criticality
Authors: Claudius Gros
Subjects: Neurons and Cognition (q-bio.NC); Adaptation and Self-Organizing Systems (nlin.AO)

Stationarity of the constituents of the body and of its functionalities is a basic requirement for life, being equivalent to survival in first place. Assuming that the resting state activity of the brain serves essential functionalities, stationarity entails that the dynamics of the brain needs to be regulated on a time-averaged basis. The combination of recurrent and driving external inputs must therefore lead to a non-trivial stationary neural activity, a condition which is fulfilled for afferent signals of varying strengths only close to criticality. In this view, the benefits of working vicinity of a second-order phase transition, such as signal enhancements, are not the underlying evolutionary drivers, but side effects of the requirement to keep the brain functional in first place. It is hence more appropriate to use the term 'self-regulated' in this context, instead of 'self-organized'.

[3]  arXiv:2104.09218 [pdf]
Title: Activity stabilization in a population model of working memory by sinusoidal and noisy inputs
Comments: 35 pages, 10 figures, to be published in Frontiers in Neural Circuits
Subjects: Neurons and Cognition (q-bio.NC)

According to mechanistic theories of working memory (WM), information is retained as persistent spiking activity of cortical neural networks. Yet, how this activity is related to changes in the oscillatory profile observed during WM tasks remains an open issue. We explore joint effects of input gamma-band oscillations and noise on the dynamics of several firing rate models of WM. The considered models have a metastable active regime, i.e. they demonstrate long-lasting transient post-stimulus firing rate elevation. We start from a single excitatory-inhibitory circuit and demonstrate that either gamma-band or noise input could stabilize the active regime, thus supporting WM retention. We then consider a system of two circuits with excitatory intercoupling. We find that fast coupling allows for better stabilization by common noise compared to independent noise and stronger amplification of this effect by in-phase gamma inputs compared to anti-phase inputs. Finally, we consider a multi-circuit system comprised of two clusters, each containing a group of circuits receiving a common noise input and a group of circuits receiving independent noise. Each cluster is associated with its own local gamma generator, so all its circuits receive gamma-band input in the same phase. We find that gamma-band input differentially stabilizes the activity of the "common-noise" groups compared to the "independent-noise" groups. If the inter-cluster connections are fast, this effect is more pronounced when the gamma-band input is delivered to the clusters in the same phase rather than in the anti-phase. Assuming that the common noise comes from a large-scale distributed WM representation, our results demonstrate that local gamma oscillations can stabilize the activity of the corresponding parts of this representation, with stronger effect for fast long-range connections and synchronized gamma oscillations.

[4]  arXiv:2104.09424 [pdf, other]
Title: Modeling the Nervous System as An Open Quantum System
Comments: 8 pages, 9 figures
Subjects: Neurons and Cognition (q-bio.NC); Quantum Physics (quant-ph)

We propose a neural model of multi-spin interacting system simulating neurons that interact each other through the surroundings. In such open system approach, we consider the neurons coupled with their surroundings including the axons connecting between neurons and the glial cells which distribute around the neurons. The surrounding environment is physically modeled as a collection of all kinds of vibrational modes. By solving the dynamics of neurons, we analyze the neural collective behavior. The action potential is taken into account for simulating the environmental effect from the surroundings, which mimics the neural firing mechanism. We find that this model can generate random neuron-neuron interactions and is proper to describe the process of information transmission in the nervous system. The physical meaning behind the scene can also be explained.

Cross-lists for Tue, 20 Apr 21

[5]  arXiv:2104.09447 (cross-list from cs.CV) [pdf, other]
Title: What can human minimal videos tell us about dynamic recognition models?
Comments: Published as a workshop paper at Bridging AI and Cognitive Science (ICLR 2020). Extended paper was published at Cognition
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Neurons and Cognition (q-bio.NC)

In human vision objects and their parts can be visually recognized from purely spatial or purely temporal information but the mechanisms integrating space and time are poorly understood. Here we show that human visual recognition of objects and actions can be achieved by efficiently combining spatial and motion cues in configurations where each source on its own is insufficient for recognition. This analysis is obtained by identifying minimal videos: these are short and tiny video clips in which objects, parts, and actions can be reliably recognized, but any reduction in either space or time makes them unrecognizable. State-of-the-art deep networks for dynamic visual recognition cannot replicate human behavior in these configurations. This gap between humans and machines points to critical mechanisms in human dynamic vision that are lacking in current models.

Replacements for Tue, 20 Apr 21

[6]  arXiv:2104.07059 (replaced) [pdf]
Title: Neural population geometry: An approach for understanding biological and artificial neural networks
Subjects: Neurons and Cognition (q-bio.NC); Machine Learning (cs.LG)
[7]  arXiv:2004.05069 (replaced) [pdf]
Title: Beyond Rescorla-Wagner: the ups and downs of learning
Comments: 39 pages, 11 figures, 8 tables. v2: discussion improved, figures added, some parts shortened, conclusions unchanged, matches published version
Journal-ref: Comput. Brain Behav. (2021)
Subjects: Quantitative Methods (q-bio.QM); Neurons and Cognition (q-bio.NC)
[8]  arXiv:2005.01081 (replaced) [pdf, ps, other]
Title: Multialternative Neural Decision Processes
Subjects: Artificial Intelligence (cs.AI); Theoretical Economics (econ.TH); Neurons and Cognition (q-bio.NC)
[9]  arXiv:2012.03303 (replaced) [pdf, other]
Title: A Tridomain Model for Potassium Clearance in Optic Nerve of Necturus
Comments: 35 pages, 13 figures
Subjects: Biological Physics (physics.bio-ph); Analysis of PDEs (math.AP); Neurons and Cognition (q-bio.NC)
[ total of 9 entries: 1-9 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, q-bio, recent, 2104, contact, help  (Access key information)