We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: FeatureBooster: Boosting Feature Descriptors with a Lightweight Neural Network

Abstract: We introduce a lightweight network to improve descriptors of keypoints within the same image. The network takes the original descriptors and the geometric properties of keypoints as the input, and uses an MLP-based self-boosting stage and a Transformer-based cross-boosting stage to enhance the descriptors. The enhanced descriptors can be either real-valued or binary ones. We use the proposed network to boost both hand-crafted (ORB, SIFT) and the state-of-the-art learning-based descriptors (SuperPoint, ALIKE) and evaluate them on image matching, visual localization, and structure-from-motion tasks. The results show that our method significantly improves the performance of each task, particularly in challenging cases such as large illumination changes or repetitive patterns. Our method requires only 3.2ms on desktop GPU and 27ms on embedded GPU to process 2000 features, which is fast enough to be applied to a practical system.
Comments: 14 pages, 8 figures, 5 tables
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2211.15069 [cs.CV]
  (or arXiv:2211.15069v1 [cs.CV] for this version)

Submission history

From: Xinjiang Wang [view email]
[v1] Mon, 28 Nov 2022 05:06:03 GMT (3949kb,D)

Link back to: arXiv, form interface, contact.