Transformer Attention-Guided Dual-Path Framework for Bearing Fault Diagnosis
Source abstract
Abstract
Reliable bearing fault diagnosis plays an important role in maintaining the safety and performance of rotating machinery in industrial systems. Although deep learning models have achieved remarkable success in this field, their dependence on a single feature-extraction approach often restricts the diversity of learned representations and limits diagnostic accuracy. To overcome this limitation, this study proposes an attention-guided dual-path framework that integrates spatial and time–frequency feature learning with transformer-based classification for precise fault identification. In the proposed framework, vibration signals collected from an experimental bearing test rig are simultaneously processed through two complementary pipelines: one converts the signals into two-dimensional matrix images to extract spatial features, while the other transforms them into continuous wavelet transform (CWT) scalograms to capture fine-grained temporal and spectral information. The extracted features are fused through a lightweight transformer encoder with an attention mechanism that dynamically emphasizes the most informative representations. This fusion enables the model to effectively capture cross-domain dependencies and enhance discriminative capability. Experimental validation on an industrial vibration dataset demonstrates that the proposed model achieves 99.87% classification accuracy, outperforming conventional CNN and transformer-based approaches. The results confirm that integrating multi-domain features with attention-driven fusion significantly improves the robustness and generalization of deep learning models for intelligent bearing fault diagnosis.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Fault Diagnosis Techniques · Gear and Bearing Dynamics Analysis · Machine Learning and ELM
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
PD Technology Co., Ltd., Ulsan 44610, Republic of Korea
Funding
Ministry of Trade, Industry, & Energy
References (40)
Show source-provided references
1. Cyclostationary-based Multiband Envelope Spectra Extraction for bearing diagnostics: The Combined Improved Envelope Spectrum10.1016/j.ymssp.2020.107150 ↗
2. A systematic literature review of deep learning for vibration-based fault diagnosis of critical rotating machinery: Limitations and challenges10.1016/j.jsv.2024.118562 ↗
3. Bazurto, A.J., Quispe, E.C., and Mendoza, R.C. (2016, January 19–21). Causes and failures classification of industrial electric motor. Proceedings of the 2016 IEEE ANDESCON, Arequipa, Peru.10.1109/ANDESCON.2016.7836190 ↗
4. Fault diagnoses of a nonlinear cracked rotor-bearing system based on vibration energy space and incremental learning approach10.1016/j.jsv.2024.118785 ↗
5. An improved GNN using dynamic graph embedding mechanism: A novel end-to-end framework for rolling bearing fault diagnosis under variable working conditions10.1016/j.ymssp.2023.110534 ↗
6. A novel vibration-based prognostic scheme for gear health management in surface wear progression of the intelligent manufacturing system10.1016/j.wear.2023.204697 ↗
7. Reliability assessment and prediction of rolling bearings based on hybrid noise reduction and BOA-MKRVM10.1016/j.engappai.2022.105391 ↗
8. Hidden Markov Model based Stochastic Resonance and its Application to Bearing Fault Diagnosis10.1016/j.jsv.2022.116890 ↗
9. Three-dimensional dynamic modeling and vibration analysis of roller bearings under compound fault excitation10.1016/j.jsv.2025.119188 ↗
10. A structurally re-parameterized convolution neural network-based method for gearbox fault diagnosis in edge computing scenarios10.1016/j.engappai.2023.107091 ↗
11. Product envelope spectrum optimization-gram: An enhanced envelope analysis for rolling bearing fault diagnosis10.1016/j.ymssp.2023.110270 ↗
12. Second-order transient-extracting S transform for fault feature extraction in rolling bearings10.1016/j.ress.2022.108955 ↗
13. Siddique, M.F., Zaman, W., Ullah, S., Umar, M., Saleem, F., Shon, D., Yoon, T.H., Yoo, D.-S., and Kim, J.-M. (2024). Advanced Bearing-Fault Diagnosis and Classification Using Mel-Scalograms and FOX-Optimized ANN. Sensors, 24.10.3390/s24227303 ↗
14. Online Fault Diagnosis Method Based on Transfer Convolutional Neural Networks10.1109/TIM.2019.2902003 ↗
15. A two-stage sound-vibration signal fusion method for weak fault detection in rolling bearing systems10.1016/j.ymssp.2022.109012 ↗
16. Altaf, M., Akram, T., Khan, M.A., Iqbal, M., Ch, M.M.I., and Hsu, C.-H. (2022). A New Statistical Features Based Approach for Bearing Fault Diagnosis Using Vibration Signals. Sensors, 22.10.3390/s22052012 ↗
17. Modified multiscale weighted permutation entropy and optimized support vector machine method for rolling bearing fault diagnosis with complex signals10.1016/j.isatra.2020.12.054 ↗
18. New imbalanced bearing fault diagnosis method based on Sample-characteristic Oversampling TechniquE (SCOTE) and multi-class LS-SVM10.1016/j.asoc.2020.107043 ↗
19. Precise transformer fault diagnosis via random forest model enhanced by synthetic minority over-sampling technique10.1016/j.epsr.2023.109361 ↗
20. Graph-based semi-supervised random forest for rotating machinery gearbox fault diagnosis10.1016/j.conengprac.2021.104952 ↗
21. Fault detection and diagnosis strategy based on k-nearest neighbors and fuzzy C-means clustering algorithm for industrial processes10.1016/j.jfranklin.2022.06.022 ↗
22. Use of empirical mode decomposition and K- nearest neighbour classifier for rolling element bearing fault diagnosis10.1016/j.matpr.2021.10.152 ↗
23. Deep learning and its applications to machine health monitoring10.1016/j.ymssp.2018.05.050 ↗
24. End-to-end CNN + LSTM deep learning approach for bearing fault diagnosis10.1007/s10489-020-01859-1 ↗
25. A Meta-Learning Method for Electric Machine Bearing Fault Diagnosis Under Varying Working Conditions with Limited Data10.1109/TII.2022.3165027 ↗
26. A Motor Current Signal-Based Bearing Fault Diagnosis Using Deep Learning and Information Fusion10.1109/TIM.2019.2933119 ↗
27. Deep order-wavelet convolutional variational autoencoder for fault identification of rolling bearing under fluctuating speed conditions10.1016/j.eswa.2022.119479 ↗
28. A novel rolling bearing fault diagnosis method based on Adaptive Denoising Convolutional Neural Network under noise background10.1016/j.measurement.2023.113209 ↗
29. A hybrid intelligent rolling bearing fault diagnosis method combining WKN-BiLSTM and attention mechanism10.1088/1361-6501/acce55 ↗
30. A systematic review of rolling bearing fault diagnoses based on deep learning and transfer learning: Taxonomy, overview, application, open challenges, weaknesses and recommendations10.1016/j.asej.2022.101945 ↗
31. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
32. A hybrid attention improved ResNet based fault diagnosis method of wind turbines gearbox10.1016/j.measurement.2021.109491 ↗
33. Intelligent fault diagnosis of rolling bearing based on wavelet transform and improved ResNet under noisy labels and environment10.1016/j.engappai.2022.105269 ↗
34. Deep Residual Shrinkage Networks for Fault Diagnosis10.1109/TII.2019.2943898 ↗
35. Interpretable domain adaptation transformer: A transfer learning method for fault diagnosis of rotating machinery10.1177/14759217241249656 ↗
36. Wang, Z., and Oates, T. (2015, January 25–26). Encoding time series as images for visual inspection and classification using tiled convolutional neural networks. Proceedings of the Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.
37. Ahmed, H.O.A., and Nandi, A.K. (2022). Vibration Image Representations for Fault Diagnosis of Rotating Machines: A Review. Machines, 10.10.3390/machines10121113 ↗
38. Wavelets for fault diagnosis of rotary machines: A review with applications10.1016/j.sigpro.2013.04.015 ↗
39. A hybrid deep-learning model for fault diagnosis of rolling bearings10.1016/j.measurement.2020.108502 ↗
40. Lessmeier, C., Kimotho, J.K., Zimmer, D., and Sextro, W. (2016). Condition Monitoring of Bearing Damage in Electromechanical Drive Systems by Using Motor Current Signals of Electric Motors: A Benchmark Data Set for Data-Driven Classification. PHM Soc. Eur. Conf., 3.10.36001/phme.2016.v3i1.1577 ↗