Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning Rapid-Temporal Adaptations
(Submitted on 28 Dec 2017 (this version), latest version 3 Jul 2018 (v3))
Abstract: A hallmark of human intelligence and cognition is its flexibility. One of the long-standing goals in AI research is to replicate this flexibility in a learning machine. In this work we describe a mechanism by which artificial neural networks can learn rapid-temporal adaptation - the ability to adapt quickly to new environments or tasks - that we call adaptive neurons. Adaptive neurons modify their activations with task-specific values retrieved from a working memory. On standard metalearning and few-shot learning benchmarks in both vision and language domains, models augmented with adaptive neurons achieve state-of-the-art results.
Submission history
From: Tsendsuren Munkhdalai [view email][v1] Thu, 28 Dec 2017 16:47:13 GMT (117kb,D)
[v2] Wed, 7 Mar 2018 15:27:42 GMT (975kb,D)
[v3] Tue, 3 Jul 2018 18:04:34 GMT (1082kb,D)
Link back to: arXiv, form interface, contact.