References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: DISK: Learning local features with policy gradient
(Submitted on 24 Jun 2020 (v1), last revised 27 Oct 2020 (this version, v2))
Abstract: Local feature frameworks are difficult to learn in an end-to-end fashion, due to the discreteness inherent to the selection and matching of sparse keypoints. We introduce DISK (DIScrete Keypoints), a novel method that overcomes these obstacles by leveraging principles from Reinforcement Learning (RL), optimizing end-to-end for a high number of correct feature matches. Our simple yet expressive probabilistic model lets us keep the training and inference regimes close, while maintaining good enough convergence properties to reliably train from scratch. Our features can be extracted very densely while remaining discriminative, challenging commonly held assumptions about what constitutes a good keypoint, as showcased in Fig. 1, and deliver state-of-the-art results on three public benchmarks.
Submission history
From: Michał Tyszkiewicz [view email][v1] Wed, 24 Jun 2020 08:57:38 GMT (6325kb,D)
[v2] Tue, 27 Oct 2020 10:32:54 GMT (7326kb,D)
Link back to: arXiv, form interface, contact.