Research on Fault Diagnosis of Rotating Parts Based on Transformer Deep Learning Model
Source abstract
Abstract
The rotating parts of large and complex equipment are key components that ensure the normal operation of the equipment. Accurate fault diagnosis is crucial for the safe operation of these systems. To simultaneously extract both local and global valuable fault feature information from key components of complex equipment, this study proposes a fault diagnosis network model, named MultiDilatedFormer, which is based on the fusion of transformer and multi-head dilated convolution. The newly designed multi-head dilated convolution module is sequentially integrated into the transformer-encoder architecture, constructing a feature extraction module where the complementary advantages of both components enhance overall performance. Firstly, the sample is expanded into a two-dimensional feature map and then input into the newly designed feature extraction module. Finally, the diagnostic output is performed by the designed patch feature fusion module and classifier module. Additionally, interpretability research is conducted on the proposed model, aiming to understand the decision-making mechanism of the model through visual analysis of the entire decision process. The experimental results on three different datasets indicate that the proposed model achieved high accuracy in fault diagnosis with relatively short data windows. The highest accuracy reached 97.95%, which was up to 10.97% higher than other models. Furthermore, the feasibility of the model is also verified in the actual dataset of the rotating parts of the injection molding machine. The excellent performance of the model on different datasets demonstrates its effectiveness in extracting comprehensive fault feature information and also proves its great potential in practical industrial applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Engineering Diagnostics and Reliability · Machine Fault Diagnosis Techniques · Fault Detection and Control Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electromechanical Engineering, Guangdong University of Technology, Guangzhou 510006, China
Funding
National Natural Science Foundation of China · Guangdong Science and Technology Plan Project · Guangdong Basic and Applied Basic Research Foundation · Key-Area Research and Development Program of Guangdong Province
References (30)
Show source-provided references
1. Engineering management for high-end equipment intelligent manufacturing10.15302/J-FEM-2018050 ↗
2. Deng, Y., Guo, C., Zhang, Z., Zou, L., Liu, X., and Lin, S. (2023). An Attention-Based Method for Remaining Useful Life Prediction of Rotating Machinery. Appl. Sci., 13.10.3390/app13042622 ↗
3. Rolling bearing fault diagnosis based on multi-scale weighted visibility graph and multi-channel graph convolution network10.1088/1361-6501/ace7e5 ↗
4. Yu, F., and Koltun, V. (2015). Multi-scale context aggregation by dilated convolutions. arXiv.
5. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. arXiv.
6. Rolling Bearing Fault Diagnosis Based on One-Dimensional Dilated Convolution Network with Residual Connection10.1109/ACCESS.2021.3059761 ↗
7. Chen, J., Xu, Q., Guo, Y., and Chen, R. (2022). Aircraft Landing Gear Retraction/Extension System Fault Diagnosis with 1-D Dilated Convolutional Neural Network. Sensors, 22.10.3390/s22041367 ↗
8. A fault diagnosis method based on dilated convolution and attention for rolling bearing under multiple working conditions and noisy environments10.21595/jve.2023.23326 ↗
9. Local Transformer with Spatial Partition Restore for Hyperspectral Image Classification10.1109/JSTARS.2022.3174135 ↗
10. Cao, K., and Wang, M. (2023). Human behavior recognition based on sparse transformer with channel attention mechanism. Front. Physiol., 14.10.3389/fphys.2023.1239453 ↗
11. Tang, X., Xu, Z., and Wang, Z. (2022). A Novel Fault Diagnosis Method of Rolling Bearing Based on Integrated Vision Transformer Model. Sensors, 22.10.3390/s22103878 ↗
12. A Fault Diagnosis Method for Rolling Bearing Based on 1D-ViT Model10.1109/ACCESS.2023.3268534 ↗
13. Diagnosisformer: An efficient rolling bearing fault diagnosis method based on improved Transformer10.1016/j.engappai.2023.106507 ↗
14. Si, C., Yu, W., Zhou, P., Zhou, Y., Wang, X., and Yan, S. (2022). Inception transformer. arXiv.
15. Ahmed, H.O.A., and Nandi, A.K. (2023). Convolutional-Transformer Model with Long-Range Temporal Dependencies for Bearing Fault Diagnosis Using Vibration Signals. Machines, 11.10.3390/machines11070746 ↗
16. Liu, W., Zhang, Z., Zhang, J., Huang, H., Zhang, G., and Peng, M. (2023). A Novel Fault Diagnosis Method of Rolling Bearings Combining Convolutional Neural Network and Transformer. Electronics, 12.10.3390/electronics12081838 ↗
17. Rotating Machinery Fault Diagnosis Under Multiple Working Conditions via a Time-Series Transformer Enhanced by Convolutional Neural Network10.1109/TIM.2023.3329222 ↗
18. Auto-Embedding Transformer for Interpretable Few-Shot Fault Diagnosis of Rolling Bearings10.1109/TR.2023.3328597 ↗
19. Time-series weather prediction in the Red sea using ensemble transformers10.1016/j.asoc.2024.111926 ↗
20. A Novel Multisensor Fusion Transformer and Its Application into Rotating Machinery Fault Diagnosis
21. Bearing Fault Identification Based on Deep Convolution Residual Network10.5755/j02.mech.28265 ↗
22. Fault diagnosis for small samples based on attention mechanism10.1016/j.measurement.2021.110242 ↗
23. Zhang, W., Peng, G., Li, C., Chen, Y., and Zhang, Z. (2017). A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals. Sensors, 17.10.20944/preprints201701.0132.v1 ↗
24. Fault detection and classification with feature representation based on deep residual convolutional neural network10.1002/cem.3170 ↗
25. Interpretability of deep convolutional neural networks on rolling bearing fault diagnosis10.1088/1361-6501/ac41a5 ↗
26. XJTU-SY Rolling Element Bearing Accelerated Life Test Datasets: A Tutorial10.3901/JME.2019.16.001 ↗
27. Rolling element bearing diagnosis using the Case Western reserve university data: A benchmark study
28. Shi, L., Su, S., Wang, W., Gao, S., and Chu, C. (2023). Bearing Fault Diagnosis Method Based on Deep Learning and Health State Division. Appl. Sci., 13.10.3390/app13137424 ↗
29. A data-driven predictive maintenance framework for injection molding process10.1016/j.jmapro.2022.06.013 ↗
30. Study on the evaluation and compensating strategy for the wear damage of non-return valve during injection molding process10.1002/pen.26246 ↗