We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Transformers in Time-series Analysis: A Tutorial

Abstract: Transformer architecture has widespread applications, particularly in Natural Language Processing and computer vision. Recently Transformers have been employed in various aspects of time-series analysis. This tutorial provides an overview of the Transformer architecture, its applications, and a collection of examples from recent research papers in time-series analysis. We delve into an explanation of the core components of the Transformer, including the self-attention mechanism, positional encoding, multi-head, and encoder/decoder. Several enhancements to the initial, Transformer architecture are highlighted to tackle time-series tasks. The tutorial also provides best practices and techniques to overcome the challenge of effectively training Transformers for time-series analysis.
Comments: 28 pages, 17 figures
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2205.01138 [cs.LG]
  (or arXiv:2205.01138v1 [cs.LG] for this version)

Submission history

From: Sabeen Ahmed [view email]
[v1] Thu, 28 Apr 2022 05:17:45 GMT (1370kb,D)

Link back to: arXiv, form interface, contact.