We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images

Abstract: Existing state-of-the-art methods for Video Object Segmentation (VOS) learn low-level pixel-to-pixel correspondences between frames to propagate object masks across video. This requires a large amount of densely annotated video data, which is costly to annotate, and largely redundant since frames within a video are highly correlated. In light of this, we propose HODOR: a novel method that tackles VOS by effectively leveraging annotated static images for understanding object appearance and scene context. We encode object instances and scene information from an image frame into robust high-level descriptors which can then be used to re-segment those objects in different frames. As a result, HODOR achieves state-of-the-art performance on the DAVIS and YouTube-VOS benchmarks compared to existing methods trained without video annotations. Without any architectural modification, HODOR can also learn from video context around single annotated video frames by utilizing cyclic consistency, whereas other methods rely on dense, temporally consistent annotations. Source code is available at: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
ACM classes: I.4.6; I.4.8; I.4.10
DOI: 10.1109/CVPR52688.2022.00303
Cite as: arXiv:2112.09131 [cs.CV]
  (or arXiv:2112.09131v2 [cs.CV] for this version)

Submission history

From: Ali Athar [view email]
[v1] Thu, 16 Dec 2021 18:59:53 GMT (16813kb,D)
[v2] Fri, 15 Jul 2022 13:15:16 GMT (13436kb,D)

Link back to: arXiv, form interface, contact.