References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Dual-stream spatiotemporal networks with feature sharing for monitoring animals in the home cage
(Submitted on 1 Jun 2022 (this version), latest version 3 Nov 2022 (v2))
Abstract: This paper presents a spatiotemporal deep learning approach for mouse behavioural classification in the home cage. Using a series of dual-stream architectures with assorted modifications to increase performance, we introduce a novel feature-sharing approach that jointly processes the streams at regular intervals throughout the network. Using a publicly available labelled dataset of singly-housed mice, we achieve a prediction accuracy of 86.47% using an ensemble of Inception-based networks that utilize feature sharing. We also demonstrate through ablation studies that for all models, the feature-sharing architectures consistently perform better than conventional ones having separate streams. The best performing models were further evaluated on other activity datasets, both mouse and human, and achieved state-of-the-art results. Future work will investigate the effectiveness of feature sharing in behavioural classification in the unsupervised anomaly detection domain.
Submission history
From: Ezechukwu Nwokedi [view email][v1] Wed, 1 Jun 2022 16:32:25 GMT (1366kb)
[v2] Thu, 3 Nov 2022 23:02:29 GMT (7700kb,D)
Link back to: arXiv, form interface, contact.