We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: GKS: Graph-based Knowledge Selector for Task-oriented Dialog System

Abstract: In previous research, knowledge-selection tasks mostly rely on language model-based methods or knowledge ranking. However, while approaches that rely on the language models take all knowledge as sequential input, knowledge does not contain sequential information in most circumstances. On the other hand, the knowledge-ranking methods leverage dialog history and each given knowledge snippet separately, but they do not consider information between knowledge snippets. In the Tenth Dialog System Technology Challenges (DSTC10), we participated in the second Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations. To deal with the problems mentioned above, we modified training methods based on state-of-the-art (SOTA) models for the first and third sub-tasks. As for the second sub-task of knowledge selection, we proposed Graph-Knowledge Selector (GKS), utilizing a graph-attention base model incorporated with the language model. GKS makes knowledge-selection decisions in the dialog by simultaneously considering each knowledge embedding generated from the language model without sequential features. Moreover, GKS leverages considerable knowledge in decision-making and takes relations across knowledge as part of the selection process. As a result, GKS outperforms several SOTA models proposed in the data-set on knowledge selection from the Ninth Dialog System Technology Challenges (DSTC9).
Comments: Accepted to The Tenth Dialog System Technology Challenge Workshop at Association for the Advancement of Artificial Intelligence (AAAI) 2022
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2112.03719 [cs.CL]
  (or arXiv:2112.03719v2 [cs.CL] for this version)

Submission history

From: Jia-Yan Wu [view email]
[v1] Tue, 7 Dec 2021 14:16:26 GMT (5869kb,D)
[v2] Sun, 26 Dec 2021 07:43:33 GMT (4518kb,D)

Link back to: arXiv, form interface, contact.