Remaining Useful Life Prediction of Rolling Bearings Based on Empirical Mode Decomposition and Transformer Bi-LSTM Network
Source abstract
Abstract
Remaining useful life (RUL) prediction is critical for ensuring the reliability and safety of industrial equipment. In recent years, Transformer-based models have been widely employed in RUL prediction tasks for rolling bearings, owing to their superior capability in capturing global features. However, Transformers exhibit limitations in extracting local temporal features, making it challenging to fully model the degradation process. To address this issue, this paper proposes a parallel hybrid prediction approach based on Transformer and Long Short-Term Memory (LSTM) networks. The proposed method begins by applying Empirical Mode Decomposition (EMD) to the raw vibration signals of rolling bearings, decomposing them into a series of Intrinsic Mode Functions (IMFs), from which statistical features are extracted. These features are then normalized and used to construct the input dataset for the model. In the model architecture, the LSTM network is employed to capture local temporal dependencies, while the Transformer module is utilized to model long-range relationships for RUL prediction. The performance of the proposed method is evaluated using mean absolute error (MAE) and root mean square error (RMSE). Experimental validation is conducted on the PHM2012 dataset, along with generalization experiments on the XJTU-SY dataset. The results demonstrate that the proposed Transformer–LSTM approach achieves high prediction accuracy and strong generalization performance, outperforming conventional methods such as LSTM and GRU.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Fault Diagnosis Techniques · Gear and Bearing Dynamics Analysis · Engineering Diagnostics and Reliability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, China
Hebei XuanGong Machinery Development Co., Ltd., Zhangjiakou 075100, China
Funding
National Key Research and Development Program of China
References (36)
Show source-provided references
1. A review on the application of deep learning in system health management10.1016/j.ymssp.2017.11.024 ↗
2. PHM-oriented integrated fusion prognostics for aircraft engines based on sensor data10.1109/JSEN.2013.2293517 ↗
3. Data amplification for bearing remaining useful life prediction based on generative adversarial network
4. Manifold sensing-based convolution sparse self-learning for defective bearing morphological feature extraction10.1109/TII.2020.3030186 ↗
5. Category-aware dual adversarial domain adaptation model for rolling bearings fault diagnosis under variable conditions10.1088/1361-6501/acd6ac ↗
6. Yang, G. (2012). Practical Techniques for Fault Diagnosis of Rolling Bearings, China Petrochemical Press.
7. Reliable multiple combined fault diagnosis of bearings using heterogeneous feature models and multiclass support vector machines10.1016/j.ress.2018.02.012 ↗
8. Zhang, Y., Zhang, M., Wang, Y., and Xie, L. (2020). Fatigue life analysis of ball bearings and a shaft system considering the combined bearing preload and angular misalignment. Appl. Sci., 10.10.3390/app10082750 ↗
9. Wang, C., Jiang, W., Yang, X., and Zhang, S. (2021). RUL Prediction of Rolling Bearings Based on a DCAE and CNN. Appl. Sci., 11.10.3390/app112311516 ↗
10. A Model-Based Method for Remaining Useful Life Prediction of Machinery10.1109/TR.2016.2570568 ↗
11. A New Statistical Modeling and Detection Method for Rolling Element Bearing Faults Based on Alpha–Stable Distribution10.1016/j.ymssp.2013.08.015 ↗
12. Cascade fusion convolutional long-short time memory network for remaining useful life prediction of rolling bearing10.1109/ACCESS.2020.2970444 ↗
13. A remaining useful life prediction method of rolling bearings by RSA-BAF combined with Copula Entropy feature selection10.1016/j.eswa.2025.127100 ↗
14. Yiran, R., Jianhua, L., Mejed, J., and Baili, Z. (2023, January 23–25). An AC Contactor Remaining Useful Life Prediction Method based on Degradation Event Analysis. Proceedings of the 2023 6th International Symposium on Autonomous Systems (ISAS), Nanjing, China.
15. Bearing remaining useful life prediction using support vector machine and hybrid degradation tracking model10.1016/j.isatra.2019.08.058 ↗
16. Simultaneous bearing fault recognition and remaining useful life prediction using joint-loss convolutional neural network10.1109/TII.2019.2915536 ↗
17. A remaining useful life prediction method for bearing based on deep neural networks10.1016/j.measurement.2020.108878 ↗
18. Estimation of bearing remaining useful life based on multiscale convolutional neural network10.1109/TIE.2018.2844856 ↗
19. Remaining useful life prediction techniques for electric valves based on convolution auto encoder and long ort term memory10.1016/j.isatra.2020.08.031 ↗
20. Remaining useful life prediction for rolling bearings using multi-layer grid search and LSTM10.1016/j.compeleceng.2022.108083 ↗
21. Deep transfer learning based on Bi-LSTM and attention for remaining useful life prediction of rolling bearing10.1016/j.ress.2022.108914 ↗
22. Deep separable convolutional network for remaining useful life prediction of machinery10.1016/j.ymssp.2019.106330 ↗
23. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
24. Remaining useful life prediction method of rolling bearing based on transformer model
25. Lu, Y., Cheng, S., Zhu, D., Zhao, D., and Gao, Q. (2025). Remaining Useful Life Prediction of Rolling Bearings Based on Multi-wavelet-time Convolution Transformer. Meas. Sci. Technol., in press.10.1088/1361-6501/adc9d3 ↗
26. Remaining useful life prediction of rolling bearings based on time convolutional network and Transformer in parallel10.1088/1361-6501/ad73ee ↗
27. Adaptive remaining useful life prediction framework with stochastic failure threshold for experimental bearings under contaminated conditions10.1007/s13198-023-01979-0 ↗
28. Kumar, A., Berrouche, Y., Zimroz, R., Vashishtha, G., Chauhan, S., Gandhi, C.P., Tang, H., and Xiang, J. (2023). Non-parametric ensemble empirical mode decomposition for extracting weak features to identify bearing defects. arXiv.10.1016/j.measurement.2023.112615 ↗
29. Zhang, Y., Zhang, J., Xu, H., Xie, H., and Ding, H. (2024). Residual Life Prediction of Rolling Bearings Based on a CEEMDAN Algorithm Fused with CNN–Attention-Based Bidirectional LSTM Modeling. Processes, 12.10.3390/pr12010008 ↗
30. Nectoux, P., Gouriveau, R., Medjaher, K., Ramasso, E., Chebel-Morello, B., Zerhouni, N., and Varnier, C. (2012, January 18–21). Pronostia: An experimental platform for bearings accelerated degradation tests. Proceedings of the IEEE International Conference on Prognostics and Health Management, PHM’12, Denver, CO, USA.
31. RUL prediction method for rolling bearing using convolutional denoising autoencoder and bidirectional LSTM
32. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., and Polosukhin, I. (2017). Attention is all you need. arXiv.
33. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis10.1098/rspa.1998.0193 ↗
34. Learning long-term dependencies with gradient descent is difficult10.1109/72.279181 ↗
35. XITU-SY rolling element bearing accelerated life test datasets: A tutorial
36. Elouaham, S., Dliou, A., Nassiri, B., and Zougagh, H. (2023, January 23–25). Combination method for denoising EMG signals using EWT and EMD techniques. Proceedings of the IEEE International Conference on Advances in Data-Driven Analytics and Intelligent Systems (ADACIS), Marrakesh, Morocco.10.1109/ADACIS59737.2023.10424309 ↗