We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Human-Computer Interaction

Title: GazeReader: Detecting Unknown Word Using Webcam for English as a Second Language (ESL) Learners

Abstract: Automatic unknown word detection techniques can enable new applications for assisting English as a Second Language (ESL) learners, thus improving their reading experiences. However, most modern unknown word detection methods require dedicated eye-tracking devices with high precision that are not easily accessible to end-users. In this work, we propose GazeReader, an unknown word detection method only using a webcam. GazeReader tracks the learner's gaze and then applies a transformer-based machine learning model that encodes the text information to locate the unknown word. We applied knowledge enhancement including term frequency, part of speech, and named entity recognition to improve the performance. The user study indicates that the accuracy and F1-score of our method were 98.09% and 75.73%, respectively. Lastly, we explored the design scope for ESL reading and discussed the findings.
Comments: This paper has been accepted by ACM CHI 2023
Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
Cite as: arXiv:2303.10443 [cs.HC]
  (or arXiv:2303.10443v1 [cs.HC] for this version)

Submission history

From: Yuntao Wang [view email]
[v1] Sat, 18 Mar 2023 15:55:49 GMT (1432kb,D)

Link back to: arXiv, form interface, contact.