We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.NE

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Neural and Evolutionary Computing

Title: On the role of neurogenesis in overcoming catastrophic forgetting

Abstract: Lifelong learning capabilities are crucial for artificial autonomous agents operating on real-world data, which is typically non-stationary and temporally correlated. In this work, we demonstrate that dynamically grown networks outperform static networks in incremental learning scenarios, even when bounded by the same amount of memory in both cases. Learning is unsupervised in our models, a condition that additionally makes training more challenging whilst increasing the realism of the study, since humans are able to learn without dense manual annotation. Our results on artificial neural networks reinforce that structural plasticity constitutes effective prevention against catastrophic forgetting in non-stationary environments, as well as empirically supporting the importance of neurogenesis in the mammalian brain.
Comments: Accepted to NIPS'18 Workshop on Continual Learning
Subjects: Neural and Evolutionary Computing (cs.NE); Machine Learning (cs.LG)
Cite as: arXiv:1811.02113 [cs.NE]
  (or arXiv:1811.02113v2 [cs.NE] for this version)

Submission history

From: German I. Parisi [view email]
[v1] Tue, 6 Nov 2018 01:38:26 GMT (179kb,D)
[v2] Fri, 30 Nov 2018 04:41:56 GMT (179kb,D)

Link back to: arXiv, form interface, contact.