We gratefully acknowledge support from
the Simons Foundation and member institutions.

Neurons and Cognition

New submissions

[ total of 14 entries: 1-14 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Tue, 15 Jun 21

[1]  arXiv:2106.06537 [pdf]
Title: The Auditory Tuning of a Keyboard
Comments: 6 pages, 5 figures, 5 tables, submitted to MTO, Nature of replacement : Addition of an ACKNOWLEDGEMENT, citations, and a list of WORKS CITED. Note: the initial submission was seen as a kind of "announcement" only, and did therefore not meet requirements that are normal for articles. The goal was to have a very readable text only, without elements enforcing the content of the text
Subjects: Neurons and Cognition (q-bio.NC); History and Philosophy of Physics (physics.hist-ph)

An optimal auditory tunable well (circular) temperament is determined. A temperament that is applicable in practice is derived from this optimum. No other historical temperament fits as well, with this optimum. A brief comparison of temperaments is worked out.

[2]  arXiv:2106.06752 [pdf, other]
Title: EDEN: A high-performance, general-purpose, NeuroML-based neural simulator
Comments: 29 pages, 9 figures
Subjects: Neurons and Cognition (q-bio.NC)

Modern neuroscience employs in silico experimentation on ever-increasing and more detailed neural networks. The high modelling detail goes hand in hand with the need for high model reproducibility, reusability and transparency. Besides, the size of the models and the long timescales under study mandate the use of a simulation system with high computational performance, so as to provide an acceptable time to result. In this work, we present EDEN (Extensible Dynamics Engine for Networks), a new general-purpose, NeuroML-based neural simulator that achieves both high model flexibility and high computational performance, through an innovative model-analysis and code-generation technique. The simulator runs NeuroML v2 models directly, eliminating the need for users to learn yet another simulator-specific, model-specification language. EDEN's functional correctness and computational performance were assessed through NeuroML models available on the NeuroML-DB and Open Source Brain model repositories. In qualitative experiments, the results produced by EDEN were verified against the established NEURON simulator, for a wide range of models. At the same time, computational-performance benchmarks reveal that EDEN runs up to 2 orders-of-magnitude faster than NEURON on a typical desktop computer, and does so without additional effort from the user. Finally, and without added user effort, EDEN has been built from scratch to scale seamlessly over multiple CPUs and across computer clusters, when available.

[3]  arXiv:2106.07355 [pdf]
Title: Predicting the imagined contents using brain activation
Comments: Published In 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG) (pp. 1-3)
Subjects: Neurons and Cognition (q-bio.NC); Machine Learning (cs.LG)

Mental imagery refers to percept-like experiences in the absence of sensory input. Brain imaging studies suggest common, modality-specific, neural correlates imagery and perception. We associated abstract visual stimuli with either visually presented or imagined monetary rewards and scrambled pictures. Brain images for a group of 12 participants were collected using functional magnetic resonance imaging. Statistical analysis showed that human midbrain regions were activated irrespective of the monetary rewards being imagined or visually present. A support vector machine trained on the midbrain activation patterns to the visually presented rewards predicted with 75% accuracy whether the participants imagined the monetary reward or the scrambled picture during imagination trials. Training samples were drawn from visually presented trials and classification accuracy was assessed for imagination trials. These results suggest the use of machine learning technique for classification of underlying cognitive states from brain imaging data.

[4]  arXiv:2106.07490 [pdf, ps, other]
Title: Drawing Inspiration from Biological Dendrites to Empower Artificial Neural Networks
Comments: 12 pages, 1 figure, opinion article
Journal-ref: Current Opinion in Neurobiology 70 (2021): 1-10
Subjects: Neurons and Cognition (q-bio.NC)

This article highlights specific features of biological neurons and their dendritic trees, whose adoption may help advance artificial neural networks used in various machine learning applications. Advancements could take the form of increased computational capabilities and/or reduced power consumption. Proposed features include dendritic anatomy, dendritic nonlinearities, and compartmentalized plasticity rules, all of which shape learning and information processing in biological networks. We discuss the computational benefits provided by these features in biological neurons and suggest ways to adopt them in artificial neurons in order to exploit the respective benefits in machine learning.

[5]  arXiv:2106.07622 [pdf]
Title: Representative Functional Connectivity Learning for Multiple Clinical groups in Alzheimer's Disease
Subjects: Neurons and Cognition (q-bio.NC)

Mild cognitive impairment (MCI) is a high-risk dementia condition which progresses to probable Alzheimer's disease (AD) at approximately 10% to 15% per year. Characterization of group-level differences between two subtypes of MCI - stable MCI (sMCI) and progressive MCI (pMCI) is the key step to understand the mechanisms of MCI progression and enable possible delay of transition from MCI to AD. Functional connectivity (FC) is considered as a promising way to study MCI progression since which may show alterations even in preclinical stages and provide substrates for AD progression. However, the representative FC patterns during AD development for different clinical groups, especially for sMCI and pMCI, have been understudied. In this work, we integrated autoencoder and multi-class classification into a single deep model and successfully learned a set of clinical group related feature vectors. Specifically, we trained two non-linear mappings which realized the mutual transformations between original FC space and the feature space. By mapping the learned clinical group related feature vectors to the original FC space, representative FCs were constructed for each group. Moreover, based on these feature vectors, our model achieves a high classification accuracy - 68% for multi-class classification (NC vs SMC vs sMCI vs pMCI vs AD).

Cross-lists for Tue, 15 Jun 21

[6]  arXiv:2106.06743 (cross-list from eess.IV) [pdf]
Title: Hippocampus segmentation in magnetic resonance images of Alzheimer's patients using Deep machine learning
Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

Background: Alzheimers disease is a progressive neurodegenerative disorder and the main cause of dementia in aging. Hippocampus is prone to changes in the early stages of Alzheimers disease. Detection and observation of the hippocampus changes using magnetic resonance imaging (MRI) before the onset of Alzheimers disease leads to the faster preventive and therapeutic measures. Objective: The aim of this study was the segmentation of the hippocampus in magnetic resonance (MR) images of Alzheimers patients using deep machine learning method. Methods: U-Net architecture of convolutional neural network was proposed to segment the hippocampus in the real MRI data. The MR images of the 100 and 35 patients available in Alzheimers disease Neuroimaging Initiative (ADNI) dataset, was used for the train and test of the model, respectively. The performance of the proposed method was compared with manual segmentation by measuring the similarity metrics. Results: The desired segmentation achieved after 10 iterations. A Dice similarity coefficient (DSC) = 92.3%, sensitivity = 96.5%, positive predicted value (PPV) = 90.4%, and Intersection over Union (IoU) value for the train 92.94 and test 92.93 sets were obtained which are acceptable. Conclusion: The proposed approach is promising and can be extended in the prognosis of Alzheimers disease by the prediction of the hippocampus volume changes in the early stage of the disease.

[7]  arXiv:2106.07030 (cross-list from cs.NE) [pdf, other]
Title: The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware
Comments: 20 pages, 5 figures
Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

The capabilities of natural neural systems have inspired new generations of machine learning algorithms as well as neuromorphic very large-scale integrated (VLSI) circuits capable of fast, low-power information processing. However, most modern machine learning algorithms are not neurophysiologically plausible and thus are not directly implementable in neuromorphic hardware. In particular, the workhorse of modern deep learning, the backpropagation algorithm, has proven difficult to translate to neuromorphic hardware. In this study, we present a neuromorphic, spiking backpropagation algorithm based on pulse-gated dynamical information coordination and processing, implemented on Intel's Loihi neuromorphic research processor. We demonstrate a proof-of-principle three-layer circuit that learns to classify digits from the MNIST dataset. This implementation shows a path for using massively parallel, low-power, low-latency neuromorphic processors in modern deep learning applications.

[8]  arXiv:2106.07096 (cross-list from stat.ME) [pdf]
Title: A test for partial correlation between repeatedly observed nonstationary nonlinear timeseries
Subjects: Methodology (stat.ME); Neurons and Cognition (q-bio.NC); Applications (stat.AP)

We describe a family of statistical tests to measure partial correlation in vectorial timeseries. The test measures whether an observed timeseries Y can be predicted from a second series X, even after accounting for a third series Z which may correlate with X. It does not make any assumptions on the nature of these timeseries, such as stationarity or linearity, but it does require that multiple statistically independent recordings of the 3 series are available. Intuitively, the test works by asking if the series Y recorded on one experiment can be better predicted from X recorded on the same experiment than on a different experiment, after accounting for the prediction from Z recorded on both experiments.

[9]  arXiv:2106.07185 (cross-list from cs.AI) [pdf]
Title: Modeling Object Recognition in Newborn Chicks using Deep Neural Networks
Comments: Presented at CogSci 2021
Subjects: Artificial Intelligence (cs.AI); Neurons and Cognition (q-bio.NC)

In recent years, the brain and cognitive sciences have made great strides developing a mechanistic understanding of object recognition in mature brains. Despite this progress, fundamental questions remain about the origins and computational foundations of object recognition. What learning algorithms underlie object recognition in newborn brains? Since newborn animals learn largely through unsupervised learning, we explored whether unsupervised learning algorithms can be used to predict the view-invariant object recognition behavior of newborn chicks. Specifically, we used feature representations derived from unsupervised deep neural networks (DNNs) as inputs to cognitive models of categorization. We show that features derived from unsupervised DNNs make competitive predictions about chick behavior compared to supervised features. More generally, we argue that linking controlled-rearing studies to image-computable DNN models opens new experimental avenues for studying the origins and computational basis of object recognition in newborn animals.

[10]  arXiv:2106.07369 (cross-list from cs.LG) [pdf]
Title: A Self-Supervised Framework for Function Learning and Extrapolation
Comments: 15 pages, 4 figures
Subjects: Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

Understanding how agents learn to generalize -- and, in particular, to extrapolate -- in high-dimensional, naturalistic environments remains a challenge for both machine learning and the study of biological agents. One approach to this has been the use of function learning paradigms, which allow peoples' empirical patterns of generalization for smooth scalar functions to be described precisely. However, to date, such work has not succeeded in identifying mechanisms that acquire the kinds of general purpose representations over which function learning can operate to exhibit the patterns of generalization observed in human empirical studies. Here, we present a framework for how a learner may acquire such representations, that then support generalization -- and extrapolation in particular -- in a few-shot fashion. Taking inspiration from a classic theory of visual processing, we construct a self-supervised encoder that implements the basic inductive bias of invariance under topological distortions. We show the resulting representations outperform those from other models for unsupervised time series learning in several downstream function learning tasks, including extrapolation.

[11]  arXiv:2106.07411 (cross-list from cs.CV) [pdf, other]
Title: Partial success in closing the gap between human and machine vision
Comments: A preliminary version of this work was presented as Oral at the 2020 NeurIPS workshop on "Shared Visual Representations in Human & Machine Intelligence" (arXiv:2010.08377)
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

A few years ago, the first CNN surpassed human performance on ImageNet. However, it soon became clear that machines lack robustness on more challenging test cases, a major obstacle towards deploying machines "in the wild" and towards obtaining better computational models of human visual perception. Here we ask: Are we making progress in closing the gap between human and machine vision? To answer this question, we tested human observers on a broad range of out-of-distribution (OOD) datasets, adding the "missing human baseline" by recording 85,120 psychophysical trials across 90 participants. We then investigated a range of promising machine learning developments that crucially deviate from standard supervised CNNs along three axes: objective function (self-supervised, adversarially trained, CLIP language-image training), architecture (e.g. vision transformers), and dataset size (ranging from 1M to 1B). Our findings are threefold. (1.) The longstanding robustness gap between humans and CNNs is closing, with the best models now matching or exceeding human performance on most OOD datasets. (2.) There is still a substantial image-level consistency gap, meaning that humans make different errors than models. In contrast, most models systematically agree in their categorisation errors, even substantially different ones like contrastive self-supervised vs. standard supervised models. (3.) In many cases, human-to-model consistency improves when training dataset size is increased by one to three orders of magnitude. Our results give reason for cautious optimism: While there is still much room for improvement, the behavioural difference between human and machine vision is narrowing. In order to measure future progress, 17 OOD datasets with image-level human behavioural data are provided as a benchmark here: https://github.com/bethgelab/model-vs-human/

Replacements for Tue, 15 Jun 21

[12]  arXiv:2101.06057 (replaced) [pdf, other]
Title: Mean-field approximations of networks of spiking neurons with short-term synaptic plasticity
Comments: 15 pages, 7 figures
Subjects: Neurons and Cognition (q-bio.NC); Disordered Systems and Neural Networks (cond-mat.dis-nn)
[13]  arXiv:2106.03902 (replaced) [pdf]
Title: Impact of the activation rate of the hyperpolarization-activated current $I_{\rm h}$ on the neuronal membrane time constant and synaptic potential duration
Comments: 15 pages, 7 figures
Journal-ref: Eur. Phys. J. Spec. Top. (2021)
Subjects: Neurons and Cognition (q-bio.NC); Quantitative Methods (q-bio.QM); Subcellular Processes (q-bio.SC)
[14]  arXiv:2103.03230 (replaced) [pdf, other]
Title: Barlow Twins: Self-Supervised Learning via Redundancy Reduction
Comments: 13 pages, 6 figures, to appear at ICML 2021
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)
[ total of 14 entries: 1-14 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, q-bio, recent, 2106, contact, help  (Access key information)