We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Masking

Abstract: This ability to learn consecutive tasks without forgetting how to perform previously trained problems is essential for developing an online dialogue system. This paper proposes an effective continual learning for the task-oriented dialogue system with iterative network pruning, expanding and masking (TPEM), which preserves performance on previously encountered tasks while accelerating learning progress on subsequent tasks. Specifically, TPEM (i) leverages network pruning to keep the knowledge for old tasks, (ii) adopts network expanding to create free weights for new tasks, and (iii) introduces task-specific network masking to alleviate the negative impact of fixed weights of old tasks on new tasks. We conduct extensive experiments on seven different tasks from three benchmark datasets and show empirically that TPEM leads to significantly improved results over the strong competitors. For reproducibility, we submit the code and data at: this https URL
Comments: Accepted by The Annual Meeting of the Association for Computational Linguistics (ACL), 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2107.08173 [cs.CL]
  (or arXiv:2107.08173v1 [cs.CL] for this version)

Submission history

From: Binzong Geng [view email]
[v1] Sat, 17 Jul 2021 03:20:38 GMT (647kb,D)

Link back to: arXiv, form interface, contact.