References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: A Simple and Efficient Pipeline to Build an End-to-End Spatial-Temporal Action Detector
(Submitted on 7 Jun 2022 (v1), last revised 27 Oct 2022 (this version, v2))
Abstract: Spatial-temporal action detection is a vital part of video understanding. Current spatial-temporal action detection methods mostly use an object detector to obtain person candidates and classify these person candidates into different action categories. So-called two-stage methods are heavy and hard to apply in real-world applications. Some existing methods build one-stage pipelines, But a large performance drop exists with the vanilla one-stage pipeline and extra classification modules are needed to achieve comparable performance. In this paper, we explore a simple and effective pipeline to build a strong one-stage spatial-temporal action detector. The pipeline is composed by two parts: one is a simple end-to-end spatial-temporal action detector. The proposed end-to-end detector has minor architecture changes to current proposal-based detectors and does not add extra action classification modules. The other part is a novel labeling strategy to utilize unlabeled frames in sparse annotated data. We named our model as SE-STAD. The proposed SE-STAD achieves around 2% mAP boost and around 80% FLOPs reduction. Our code will be released at this https URL
Submission history
From: Lin Sui [view email][v1] Tue, 7 Jun 2022 07:31:56 GMT (1530kb,D)
[v2] Thu, 27 Oct 2022 13:11:48 GMT (1843kb,D)
Link back to: arXiv, form interface, contact.