We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IR

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Retrieval

Title: Analyzing and Simulating User Utterance Reformulation in Conversational Recommender Systems

Abstract: User simulation has been a cost-effective technique for evaluating conversational recommender systems. However, building a human-like simulator is still an open challenge. In this work, we focus on how users reformulate their utterances when a conversational agent fails to understand them. First, we perform a user study, involving five conversational agents across different domains, to identify common reformulation types and their transition relationships. A common pattern that emerges is that persistent users would first try to rephrase, then simplify, before giving up. Next, to incorporate the observed reformulation behavior in a user simulator, we introduce the task of reformulation sequence generation: to generate a sequence of reformulated utterances with a given intent (rephrase or simplify). We develop methods by extending transformer models guided by the reformulation type and perform further filtering based on estimated reading difficulty. We demonstrate the effectiveness of our approach using both automatic and human evaluation.
Comments: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
Subjects: Information Retrieval (cs.IR)
DOI: 10.1145/3477495.3531936
Cite as: arXiv:2205.01763 [cs.IR]
  (or arXiv:2205.01763v1 [cs.IR] for this version)

Submission history

From: Shuo Zhang [view email]
[v1] Tue, 3 May 2022 20:16:00 GMT (2925kb,D)

Link back to: arXiv, form interface, contact.