We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Human-Computer Interaction

Title: Natural Typing Recognition via Surface Electromyography

Abstract: By using a computer keyboard as a finger recording device, we construct the largest existing dataset for gesture recognition via surface electromyography (sEMG), and use deep learning to achieve over 90% character-level accuracy on reconstructing typed text entirely from measured muscle potentials. We prioritize the temporal structure of the EMG signal instead of the spatial structure of the electrode layout, using network architectures inspired by those used for real-time spoken language transcription. Our architecture recognizes the rapid movements of natural computer typing, which occur at irregular intervals and often overlap in time. The extensive size of our dataset also allows us to study gesture recognition after synthetically downgrading the spatial or temporal resolution, showing the system capabilities necessary for real-time gesture recognition.
Comments: v2: Correct typo in paper title
Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
Cite as: arXiv:2109.10743 [cs.HC]
  (or arXiv:2109.10743v2 [cs.HC] for this version)

Submission history

From: Michael S. Crouch [view email]
[v1] Wed, 22 Sep 2021 13:59:31 GMT (2767kb)
[v2] Wed, 29 Sep 2021 13:02:08 GMT (2767kb)

Link back to: arXiv, form interface, contact.