We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Dual-stream spatiotemporal networks with feature sharing for monitoring animals in the home cage

Abstract: This paper presents a spatiotemporal deep learning approach for mouse behavioural classification in the home-cage. Using a series of dual-stream architectures with assorted modifications to increase performance, we introduce a novel feature sharing approach that jointly processes the streams at regular intervals throughout the network. To investigate the efficacy of this approach, models were evaluated by dissociating the streams and training/testing in the same rigorous manner as the main classifiers. Using an annotated, publicly available dataset of a singly-housed mice, we achieve prediction accuracy of 86.47% using an ensemble of a Inception-based network and an attention-based network, both of which utilize this feature sharing. We also demonstrate through ablation studies that for all models, the feature-sharing architectures consistently perform better than conventional ones having separate streams. The best performing models were further evaluated on other activity datasets, both mouse and human. Future work will investigate the effectiveness of feature sharing to behavioural classification in the unsupervised anomaly detection domain.
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2206.00614 [cs.CV]
  (or arXiv:2206.00614v2 [cs.CV] for this version)

Submission history

From: Ezechukwu Nwokedi [view email]
[v1] Wed, 1 Jun 2022 16:32:25 GMT (1366kb)
[v2] Thu, 3 Nov 2022 23:02:29 GMT (7700kb,D)

Link back to: arXiv, form interface, contact.