We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Are Pre-trained Language Models Knowledgeable to Ground Open Domain Dialogues?

Abstract: We study knowledge-grounded dialogue generation with pre-trained language models. Instead of pursuing new state-of-the-art on benchmarks, we try to understand if the knowledge stored in parameters of the pre-trained models is already enough to ground open domain dialogues, and thus allows us to get rid of the dependency on external knowledge sources in generation. Through extensive experiments on benchmarks, we find that by fine-tuning with a few dialogues containing knowledge, the pre-trained language models can outperform the state-of-the-art model that requires external knowledge in automatic evaluation and human judgment, suggesting a positive answer to the question we raised.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2011.09708 [cs.CL]
  (or arXiv:2011.09708v1 [cs.CL] for this version)

Submission history

From: Yufan Zhao [view email]
[v1] Thu, 19 Nov 2020 08:22:49 GMT (181kb)

Link back to: arXiv, form interface, contact.