We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.HC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Human-Computer Interaction

Title: Deep ConvLSTM with self-attention for human activity decoding using wearables

Abstract: Decoding human activity accurately from wearable sensors can aid in applications related to healthcare and context awareness. The present approaches in this domain use recurrent and/or convolutional models to capture the spatio-temporal features from time-series data from multiple sensors. We propose a deep neural network architecture that not only captures the spatio-temporal features of multiple sensor time-series data but also selects, learns important time points by utilizing a self-attention mechanism. We show the validity of the proposed approach across different data sampling strategies on six public datasets and demonstrate that the self-attention mechanism gave a significant improvement in performance over deep networks using a combination of recurrent and convolution networks. We also show that the proposed approach gave a statistically significant performance enhancement over previous state-of-the-art methods for the tested datasets. The proposed methods open avenues for better decoding of human activity from multiple body sensors over extended periods of time. The code implementation for the proposed model is available at this https URL
Comments: 8 pages, 2 figures, 3 tables. IEEE Sensors Journal, 2020
Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Signal Processing (eess.SP)
DOI: 10.1109/JSEN.2020.3045135
Cite as: arXiv:2005.00698 [cs.HC]
  (or arXiv:2005.00698v2 [cs.HC] for this version)

Submission history

From: Satya P. Singh Ph.D. [view email]
[v1] Sat, 2 May 2020 04:30:31 GMT (548kb)
[v2] Fri, 18 Dec 2020 03:08:37 GMT (837kb)

Link back to: arXiv, form interface, contact.