Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: What Matters in Unsupervised Optical Flow
(Submitted on 8 Jun 2020 (v1), last revised 14 Aug 2020 (this version, v2))
Abstract: We systematically compare and analyze a set of key components in unsupervised optical flow to identify which photometric loss, occlusion handling, and smoothness regularization is most effective. Alongside this investigation we construct a number of novel improvements to unsupervised flow models, such as cost volume normalization, stopping the gradient at the occlusion mask, encouraging smoothness before upsampling the flow field, and continual self-supervision with image resizing. By combining the results of our investigation with our improved model components, we are able to present a new unsupervised flow technique that significantly outperforms the previous unsupervised state-of-the-art and performs on par with supervised FlowNet2 on the KITTI 2015 dataset, while also being significantly simpler than related approaches.
Submission history
From: Rico Jonschkowski [view email][v1] Mon, 8 Jun 2020 19:36:26 GMT (14688kb,D)
[v2] Fri, 14 Aug 2020 13:39:34 GMT (6966kb,D)
Link back to: arXiv, form interface, contact.