We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Disentangling Language and Knowledge in Task-Oriented Dialogs

Abstract: The Knowledge Base (KB) used for real-world applications, such as booking a movie or restaurant reservation, keeps changing over time. End-to-end neural networks trained for these task-oriented dialogs are expected to be immune to any changes in the KB. However, existing approaches breakdown when asked to handle such changes. We propose an encoder-decoder architecture (BoSsNet) with a novel Bag-of-Sequences (BoSs) memory, which facilitates the disentangled learning of the response's language model and its knowledge incorporation. Consequently, the KB can be modified with new knowledge without a drop in interpretability. We find that BoSsNet outperforms state-of-the-art models, with considerable improvements (> 10\%) on bAbI OOV test sets and other human-human datasets. We also systematically modify existing datasets to measure disentanglement and show BoSsNet to be robust to KB modifications.
Comments: Published in NAACL-HLT 2019
Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)
Cite as: arXiv:1805.01216 [cs.LG]
  (or arXiv:1805.01216v3 [cs.LG] for this version)

Submission history

From: Dinesh Raghu [view email]
[v1] Thu, 3 May 2018 10:52:26 GMT (1030kb,D)
[v2] Wed, 11 Jul 2018 17:50:13 GMT (827kb,D)
[v3] Fri, 5 Apr 2019 17:24:32 GMT (2204kb,D)

Link back to: arXiv, form interface, contact.