We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Self-Attention Neural Bag-of-Features

Abstract: In this work, we propose several attention formulations for multivariate sequence data. We build on top of the recently introduced 2D-Attention and reformulate the attention learning methodology by quantifying the relevance of feature/temporal dimensions through latent spaces based on self-attention rather than learning them directly. In addition, we propose a joint feature-temporal attention mechanism that learns a joint 2D attention mask highlighting relevant information without treating feature and temporal representations independently. The proposed approaches can be used in various architectures and we specifically evaluate their application together with Neural Bag of Features feature extraction module. Experiments on several sequence data analysis tasks show the improved performance yielded by our approach compared to standard methods.
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2201.11092 [cs.CV]
  (or arXiv:2201.11092v1 [cs.CV] for this version)

Submission history

From: Kateryna Chumachenko [view email]
[v1] Wed, 26 Jan 2022 17:54:14 GMT (315kb)

Link back to: arXiv, form interface, contact.