References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Global2Local: Efficient Structure Search for Video Action Segmentation
(Submitted on 4 Jan 2021 (v1), last revised 30 Apr 2021 (this version, v2))
Abstract: Temporal receptive fields of models play an important role in action segmentation. Large receptive fields facilitate the long-term relations among video clips while small receptive fields help capture the local details. Existing methods construct models with hand-designed receptive fields in layers. Can we effectively search for receptive field combinations to replace hand-designed patterns? To answer this question, we propose to find better receptive field combinations through a global-to-local search scheme. Our search scheme exploits both global search to find the coarse combinations and local search to get the refined receptive field combination patterns further. The global search finds possible coarse combinations other than human-designed patterns. On top of the global search, we propose an expectation guided iterative local search scheme to refine combinations effectively. Our global-to-local search can be plugged into existing action segmentation methods to achieve state-of-the-art performance.
Submission history
From: Shang-Hua Gao [view email][v1] Mon, 4 Jan 2021 12:06:03 GMT (582kb,D)
[v2] Fri, 30 Apr 2021 02:51:47 GMT (613kb,D)
Link back to: arXiv, form interface, contact.