We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: On the Impact of Speech Recognition Errors in Passage Retrieval for Spoken Question Answering

Abstract: Interacting with a speech interface to query a Question Answering (QA) system is becoming increasingly popular. Typically, QA systems rely on passage retrieval to select candidate contexts and reading comprehension to extract the final answer. While there has been some attention to improving the reading comprehension part of QA systems against errors that automatic speech recognition (ASR) models introduce, the passage retrieval part remains unexplored. However, such errors can affect the performance of passage retrieval, leading to inferior end-to-end performance. To address this gap, we augment two existing large-scale passage ranking and open domain QA datasets with synthetic ASR noise and study the robustness of lexical and dense retrievers against questions with ASR noise. Furthermore, we study the generalizability of data augmentation techniques across different domains; with each domain being a different language dialect or accent. Finally, we create a new dataset with questions voiced by human users and use their transcriptions to show that the retrieval performance can further degrade when dealing with natural ASR noise instead of synthetic ASR noise.
Comments: Accepted at 31st ACM International Conference on Information and Knowledge Management (CIKM 2022)
Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)
DOI: 10.1145/3511808.3557662
Cite as: arXiv:2209.12944 [cs.CL]
  (or arXiv:2209.12944v1 [cs.CL] for this version)

Submission history

From: Georgios Sidiropoulos [view email]
[v1] Mon, 26 Sep 2022 18:29:36 GMT (481kb)

Link back to: arXiv, form interface, contact.