References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Towards Accurate Pixel-wise Object Tracking by Attention Retrieval
(Submitted on 6 Aug 2020 (v1), last revised 8 Sep 2020 (this version, v3))
Abstract: The encoding of the target in object tracking moves from the coarse bounding-box to fine-grained segmentation map recently. Revisiting de facto real-time approaches that are capable of predicting mask during tracking, we observed that they usually fork a light branch from the backbone network for segmentation. Although efficient, directly fusing backbone features without considering the negative influence of background clutter tends to introduce false-negative predictions, lagging the segmentation accuracy. To mitigate this problem, we propose an attention retrieval network (ARN) to perform soft spatial constraints on backbone features. We first build a look-up-table (LUT) with the ground-truth mask in the starting frame, and then retrieves the LUT to obtain an attention map for spatial constraints. Moreover, we introduce a multi-resolution multi-stage segmentation network (MMS) to further weaken the influence of background clutter by reusing the predicted mask to filter backbone features. Our approach set a new state-of-the-art on recent pixel-wise object tracking benchmark VOT2020 while running at 40 fps. Notably, the proposed model surpasses SiamMask by 11.7/4.2/5.5 points on VOT2020, DAVIS2016, and DAVIS2017, respectively. We will release our code at this https URL
Submission history
From: Zhipeng Zhang [view email][v1] Thu, 6 Aug 2020 16:25:23 GMT (4160kb,D)
[v2] Fri, 7 Aug 2020 14:55:51 GMT (4160kb,D)
[v3] Tue, 8 Sep 2020 02:06:33 GMT (0kb,I)
Link back to: arXiv, form interface, contact.