A Remaining Useful Life Prediction Method for Rolling Bearings Based on Hierarchical Clustering and Transformer–GRU
Source abstract
Abstract
In the prediction of the remaining useful life (RUL) of rolling bearings, feature extraction and selection are critical prerequisites for accurate prediction, while the construction of the prediction model is the core. However, existing RUL prediction methods face two main challenges: (1) feature construction methods based on predefined indicators often ignore the correlation among features; and (2) single models typically yield limited prediction accuracy. To address these issues, this study proposes a feature selection method based on hierarchical clustering combined with the elbow method and a hybrid Transformer–GRU (Gated Recurrent Unit) model for RUL prediction. Specifically, the initially filtered feature set is further clustered using hierarchical clustering, and the optimal number of clusters is determined by the elbow method to construct a compact and representative feature set. This feature set is then input into a Transformer–GRU model, where the Transformer encoder captures temporal dependencies across time steps to generate rich feature representations, and the GRU network models their dynamic evolution over time to predict the bearing RUL. The proposed method is validated on the PHM2012 dataset. The experimental results show that after removing redundant features, the model’s training time is reduced by 8.61% and the number of parameters decreases by 23.26%. Compared with other benchmark models, the proposed Transformer–GRU model achieves a lower mean absolute error (MAE) of 0.0836 and a root mean square error (RMSE) of 0.1137, demonstrating superior predictive performance. These results confirm that the proposed feature selection method effectively eliminates feature redundancy, enhances training efficiency, and reduces model complexity, while the hybrid model significantly improves prediction accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gear and Bearing Dynamics Analysis · Machine Fault Diagnosis Techniques · Engineering Diagnostics and Reliability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Power Engineering, Zhengzhou University, No. 100 Science Street, Zhengzhou 450001, China
Funding
National Natural Science Foundation of China
References (46)
Show source-provided references
1. Lazovic, T., Marinkovic, A., Atanasovska, I., Sedak, M., and Stojanovic, B. (2024). From Innovation to Standardization—A Century of Rolling Bearing Life Formula. Machines, 12.10.3390/machines12070444 ↗
2. Procedure for Simulation of Stable Thermal Conductivity of Bearing Assemblies10.46793/adeletters.2023.2.2.3 ↗
3. Overview of Algorithms for Rolling Bearing Fault Diagnosis Based on Vibration Signal
4. Fault Diagnosis of Cross-Working Rolling Bearing Based on Multi-source Depth Domain Self-adaptation
5. Summary of Prediction of Remaining Useful Life of Rolling Bearings
6. Zhang, G., and Jiang, D. (2024). Research on the Remaining Life Prediction Method of Rolling Bearings Based on Multi-Feature Fusion. Appl. Sci., 14.10.3390/app14031294 ↗
7. A Critical Analysis of Crack Propagation Laws10.1115/1.3656900 ↗
8. Study of Fatigue Crack Initiation from Flaws Using Fracture Mechanics Theory10.1016/0013-7944(72)90048-3 ↗
9. A Study of the Applicability of Palmgren-Miner Criterion on the Fatigue Damage Accumulation of Concrete Offshore Platform
10. Cao, X., Zhang, F., Zhao, J., Duan, Y., and Guo, X. (2024). Remaining Useful Life Prediction of Rolling Bearing Based on Multi-Domain Mixed Features and Temporal Convolutional Networks. Appl. Sci., 14.10.3390/app14062354 ↗
11. A New Method of Bearing Life Prediction Based on Feature Clustering and Evaluation
12. Residual Life Prediction of Rolling Bearings Based on GOA Optimization LSTM Network
13. Remaining Useful Life Prediction Method for Rolling Bearing Based on the Long Short-Term Memory Network
14. Degradation Feature Selection for Remaining Useful Life Prediction of Rolling Element Bearings10.1002/qre.1771 ↗
15. Zhu, R., Zhang, X., Huang, Q., Li, S., and Fu, Q. (2024). Predicting the Remaining Life of Centrifugal Pump Bearings Using the KPCA–LSTM Algorithm. Energies, 17.10.3390/en17164167 ↗
16. Improved Naive Bayes Algorithm Based on Dual Feature Selection of Mutual Information and Hierarchical Clustering
17. Feng, Z., Wang, Z., Liu, X., and Li, J. (2023). Rolling Bearing Performance Degradation Assessment with Adaptive Sensitive Feature Selection and Multi-Strategy Optimized SVDD. Sensors, 23.10.3390/s23031110 ↗
18. Remaining Useful Life Prediction Based on a Double-Convolutional Neural Network Architecture10.1109/TIE.2019.2924605 ↗
19. Song, L., Wu, J., Wang, L., Chen, G., Shi, Y., and Liu, Z. (2023). Remaining Useful Life Prediction of Rolling Bearings Based on Multi-Scale Attention Residual Network. Entropy, 25.10.3390/e25050798 ↗
20. Prediction of Bearing Residual Life Based on Multi Information Fusion and GRU
21. A Piecewise Method for Bearing Remaining Useful Life Estimation Using Temporal Convolutional Networks10.1016/j.jmsy.2023.04.002 ↗
22. Remaining Useful Life Prediction Method of Rolling Bearing Based on Transformer Model
23. Pilot Protection for New Energy Access to Power Grid Based on Generalized S Transform and Pearson Correlation Coefficient
24. Visualized Determination Mode for Clustering Quantity of High-Dimensional Data
25. LSTM Wind Power Prediction Based on Combined Data Cleansing Algorithm of Self-Adaptive DBSCAN and K-Means Clustering
26. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2023). Attention Is All You Need. arXiv.
27. Li, D., Liu, X., Liu, J., and Chen, S. (2024). Intrusion Detection Research Combining Transformer and Bi-directional GRU [OL]. Comput. Eng. Appl., 1–11. Available online: https://link.cnki.net/urlid/11.2127.TP.20240819.1043.010.
28. Zeng, L. (2022). Study on Multi-stage Prediction Method of Remaining Useful Life of Rolling Bearing Based on Transformer Health Indicator. [Master’s Thesis, Chongqing University].
29. Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. arXiv.
30. Unsupervised Tool Anomaly Detection Based on AGRU Autoencoder
31. Chen, C., Guo, J., Qu, H., Wang, F., and Wang, P. (2023). Fault Diagnosis of Rolling Bearing Based on Multi-scale Convolutional Neural Network and GRU [OL]. Bearing, 1–11. Available online: https://link.cnki.net/urlid/41.1148.TH.20231012.1102.002.
32. Yang, Y. (2016). Study on Predicting the Remaining Service Life of Rolling Bearing Based on Signal Processing Method by Vibration Signal. [Master’s Thesis, Beijing University of Chemical Technology].
33. Yan, C. (2016). Degradation Assessment and Residual Life Prediction of Rolling Bearings Based on Multiple Features. [Master’s Thesis, School of Mechatronics Engineering].
34. Yin, G. (2021). Research on Useful Life Prediction of Rolling Bearing Based on Pearson-KPCA Multi-Feature Fusion. [Master’s Thesis, Harbin University of Science and Technology].
35. Experimental Studies on Relationship Between Rolling Bearing Life and State Characteristic Parameter
36. Fault Diagnosis of Rotating Machinery Based on Multiple ANFIS Combination with GAs10.1016/j.ymssp.2006.11.003 ↗
37. GRU Prediction for Performance Degradation of Rolling Bearings Based on Optimal Wavelet Packet and Mahalanobis Distance
38. Nectoux, P., Gouriveau, R., Medjaher, K., Ramasso, E., Morello, B., Zerhouni, N., and Varnier, C. (2012, January 18–21). PRONOSTIA: An Experimental Platform for Bearings Accelerated Degradation Tests. Proceedings of the PHM 2012: IEEE Conference on Prognostics and Health Management, Denver, CO, USA.
39. Extended Kalman Filtering for Remaining-Useful-Life Estimation of Bearings10.1109/TIE.2014.2336616 ↗
40. A Novel Unsupervised Feature Selection Method
41. Remaining Useful Life Prediction Algorithm for Rolling Bearing in the Early Stage
42. The Two-Staged Text Feature Selection Method with Maximum Correlation and Minimum Redundancy
43. Wang, S., Liu, Y., Liu, J., Sun, H., and Wen, W. (2024). Research on Bearing Life Prediction Algorithm Based on Improved Multi-Scale Temporal Convolutional Network. Control Eng. China.
44. Temporal convolutional network with soft thresholding and attention mechanism for machinery prognostics10.1016/j.jmsy.2021.07.008 ↗
45. A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings10.1016/j.ress.2021.107813 ↗
46. A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings10.1109/TR.2018.2882682 ↗