We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Artificial Intelligence

Title: A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings

Abstract: The scope of data-driven fault diagnosis models is greatly extended through deep learning (DL). However, the classical convolution and recurrent structure have their defects in computational efficiency and feature representation, while the latest Transformer architecture based on attention mechanism has not yet been applied in this field. To solve these problems, we propose a novel time-frequency Transformer (TFT) model inspired by the massive success of vanilla Transformer in sequence processing. Specially, we design a fresh tokenizer and encoder module to extract effective abstractions from the time-frequency representation (TFR) of vibration signals. On this basis, a new end-to-end fault diagnosis framework based on time-frequency Transformer is presented in this paper. Through the case studies on bearing experimental datasets, we construct the optimal Transformer structure and verify its fault diagnosis performance. The superiority of the proposed method is demonstrated in comparison with the benchmark models and other state-of-the-art methods.
Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Signal Processing (eess.SP)
Journal reference: Mech. Syst. Signal Process., vol. 168, p. 108616, Apr. 2022
DOI: 10.1016/j.ymssp.2021.108616
Cite as: arXiv:2104.09079 [cs.AI]
  (or arXiv:2104.09079v3 [cs.AI] for this version)

Submission history

From: Yifei Ding [view email]
[v1] Mon, 19 Apr 2021 06:53:31 GMT (3241kb,D)
[v2] Wed, 28 Jul 2021 05:29:19 GMT (3156kb,D)
[v3] Sat, 4 Dec 2021 05:49:05 GMT (3850kb,D)

Link back to: arXiv, form interface, contact.