References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Deep Analysis of CNN-based Spatio-temporal Representations for Action Recognition
(Submitted on 22 Oct 2020 (v1), last revised 29 Mar 2021 (this version, v4))
Abstract: In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry out in-depth comparative analysis to better understand the differences between these approaches and the progress made by them. To this end, we develop an unified framework for both 2D-CNN and 3D-CNN action models, which enables us to remove bells and whistles and provides a common ground for fair comparison. We then conduct an effort towards a large-scale analysis involving over 300 action recognition models. Our comprehensive analysis reveals that a) a significant leap is made in efficiency for action recognition, but not in accuracy; b) 2D-CNN and 3D-CNN models behave similarly in terms of spatio-temporal representation abilities and transferability. Our codes are available at this https URL
Submission history
From: Chun-Fu (Richard) Chen [view email][v1] Thu, 22 Oct 2020 14:26:09 GMT (6006kb)
[v2] Fri, 23 Oct 2020 00:51:53 GMT (6006kb)
[v3] Mon, 18 Jan 2021 14:50:20 GMT (6006kb)
[v4] Mon, 29 Mar 2021 14:33:42 GMT (2573kb)
Link back to: arXiv, form interface, contact.