References & Citations
Computer Science > Computation and Language
Title: Incremental Transformer with Deliberation Decoder for Document Grounded Conversations
(Submitted on 20 Jul 2019 (v1), last revised 31 Jul 2019 (this version, v3))
Abstract: Document Grounded Conversations is a task to generate dialogue responses when chatting about the content of a given document. Obviously, document knowledge plays a critical role in Document Grounded Conversations, while existing dialogue models do not exploit this kind of knowledge effectively enough. In this paper, we propose a novel Transformer-based architecture for multi-turn document grounded conversations. In particular, we devise an Incremental Transformer to encode multi-turn utterances along with knowledge in related documents. Motivated by the human cognitive process, we design a two-pass decoder (Deliberation Decoder) to improve context coherence and knowledge correctness. Our empirical study on a real-world Document Grounded Dataset proves that responses generated by our model significantly outperform competitive baselines on both context coherence and knowledge relevance.
Submission history
From: Zekang Li [view email][v1] Sat, 20 Jul 2019 18:49:36 GMT (89kb,D)
[v2] Tue, 23 Jul 2019 03:48:56 GMT (89kb,D)
[v3] Wed, 31 Jul 2019 22:09:11 GMT (200kb,D)
Link back to: arXiv, form interface, contact.