Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Overcoming Catastrophic Forgetting by Generative Regularization
(Submitted on 3 Dec 2019 (v1), last revised 19 Jun 2021 (this version, v3))
Abstract: In this paper, we propose a new method to overcome catastrophic forgetting by adding generative regularization to Bayesian inference framework. Bayesian method provides a general framework for continual learning. We could further construct a generative regularization term for all given classification models by leveraging energy-based models and Langevin-dynamic sampling to enrich the features learned in each task. By combining discriminative and generative loss together, we empirically show that the proposed method outperforms state-of-the-art methods on a variety of tasks, avoiding catastrophic forgetting in continual learning. In particular, the proposed method outperforms baseline methods over 15% on the Fashion-MNIST dataset and 10% on the CUB dataset
Submission history
From: Patrick Chen [view email][v1] Tue, 3 Dec 2019 08:17:46 GMT (399kb,D)
[v2] Mon, 24 Feb 2020 07:43:43 GMT (795kb,D)
[v3] Sat, 19 Jun 2021 06:22:47 GMT (888kb,D)
Link back to: arXiv, form interface, contact.