References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: DKM: Dense Kernelized Feature Matching for Geometry Estimation
(Submitted on 1 Feb 2022 (v1), last revised 25 Nov 2022 (this version, v3))
Abstract: Feature matching is a challenging computer vision task that involves finding correspondences between two images of a 3D scene. In this paper we consider the dense approach instead of the more common sparse paradigm, thus striving to find all correspondences. Perhaps counter-intuitively, dense methods have previously shown inferior performance to their sparse and semi-sparse counterparts for estimation of two-view geometry. This changes with our novel dense method, which outperforms both dense and sparse methods on geometry estimation. The novelty is threefold: First, we propose a kernel regression global matcher. Secondly, we propose warp refinement through stacked feature maps and depthwise convolution kernels. Thirdly, we propose learning dense confidence through consistent depth and a balanced sampling approach for dense confidence maps. Through extensive experiments we confirm that our proposed dense method, \textbf{D}ense \textbf{K}ernelized Feature \textbf{M}atching, sets a new state-of-the-art on multiple geometry estimation benchmarks. In particular, we achieve an improvement on MegaDepth-1500 of +4.9 and +8.9 AUC$@5^{\circ}$ compared to the best previous sparse method and dense method respectively. Our code is provided at this https URL
Submission history
From: Johan Edstedt [view email][v1] Tue, 1 Feb 2022 18:58:46 GMT (4381kb,D)
[v2] Mon, 6 Jun 2022 15:28:37 GMT (3301kb,D)
[v3] Fri, 25 Nov 2022 18:59:00 GMT (13680kb,D)
Link back to: arXiv, form interface, contact.