References & Citations
Computer Science > Computation and Language
Title: DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning
(Submitted on 25 May 2022 (v1), last revised 9 Oct 2022 (this version, v2))
Abstract: Building a universal conversational agent has been a long-standing goal of the dialogue research community. Most previous works only focus on a small set of dialogue tasks. In this work, we aim to build a unified dialogue foundation model (DFM) which can be used to solve massive diverse dialogue tasks. To achieve this goal, a large-scale well-annotated dialogue dataset with rich task diversity (DialogZoo) is collected. We introduce a framework to unify all dialogue tasks and propose novel auxiliary self-supervised tasks to achieve stable training of DFM on the highly diverse large scale DialogZoo corpus. Experiments show that, compared with models of the same size, DFM can achieve state-of-the-art or competitive performance on very rich cross-domain downstream dialogue tasks. This demonstrates that DFM largely extends the ability of unified dialogue pre-trained model.
Submission history
From: Zhi Chen [view email][v1] Wed, 25 May 2022 11:17:16 GMT (1547kb,D)
[v2] Sun, 9 Oct 2022 05:04:31 GMT (1709kb,D)
Link back to: arXiv, form interface, contact.