We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.HC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Human-Computer Interaction

Title: A Conceptual Framework for Implicit Evaluation of Conversational Search Interfaces

Abstract: Conversational search (CS) has recently become a significant focus of the information retrieval (IR) research community. Multiple studies have been conducted which explore the concept of conversational search. Understanding and advancing research in CS requires careful and detailed evaluation. Existing CS studies have been limited to evaluation based on simple user feedback on task completion. We propose a CS evaluation framework which includes multiple dimensions: search experience, knowledge gain, software usability, cognitive load and user experience, based on studies of conversational systems and IR. We introduce these evaluation criteria and propose their use in a framework for the evaluation of CS systems.
Comments: Accepted in MICROS (Mixed-Initiative ConveRsatiOnal Systems) Workshop at 43rd European Conference on Information Retrieval
Subjects: Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
Cite as: arXiv:2104.03940 [cs.HC]
  (or arXiv:2104.03940v1 [cs.HC] for this version)

Submission history

From: Abhishek Kaushik Mr. [view email]
[v1] Thu, 8 Apr 2021 17:33:18 GMT (537kb,D)

Link back to: arXiv, form interface, contact.