journal article·2023-02-17Open access

An Attention-Based Method for Remaining Useful Life Prediction of Rotating Machinery

Yaohua Deng, Chengwang Guo, Zilin Zhang, Linfeng Zou, Xiali Liu, Shengyu Lin

Applied Sciences· Volume 13· Issue 4

Abstract

Data imbalance and large data probability distribution discrepancies are major factors that reduce the accuracy of remaining useful life (RUL) prediction of high-reliability rotating machinery. In feature extraction, most deep transfer learning models consider the overall features but rarely attend to the local target features that are useful for RUL prediction; insufficient attention paid to local features reduces the accuracy and reliability of prediction. By considering the contribution of input data to the modeling output, a deep learning model that incorporates the attention mechanism in feature selection and extraction is proposed in our work; an unsupervised clustering method for classification of rotating machinery performance state evolution is put forward, and a similarity function is used to calculate the expected attention of input data to build an input data extraction attention module; the module is then fused with a gated recurrent unit (GRU), a variant of a recurrent neural network, to construct an attention-GRU model that combines prediction calculation and weight calculation for RUL prediction. Tests on public datasets show that the attention-GRU model outperforms traditional GRU and LSTM in RUL prediction, achieves less prediction error, and improves the performance and stability of the model.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Fault Diagnosis Techniques · Engineering Diagnostics and Reliability · Oil and Gas Production Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electromechanical Engineering, Guangdong University of Technology, Guangzhou 510006, China

Funding

National Natural Science Foundation of China · Guangdong Basic and Applied Basic Research Foundation · Key-Area Research and Development Program of Guangdong Province

References (25)

Show source-provided references
1. A Conceptual Model to Enable Prescriptive Maintenance for Etching Equipment in Semiconductor Manufacturing10.1016/j.procir.2020.05.012 ↗
2. Remaining useful lifetime prediction via deep domain adaptation10.1016/j.ress.2019.106682 ↗
3. Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization10.1016/j.ymssp.2018.03.025 ↗
4. Machinery fault diagnosis with imbalanced data using deep generative adversarial networks10.1016/j.measurement.2019.107377 ↗
5. Deep Learning-Based Cross-Machine Health Identification Method for Vacuum Pumps with Domain Adaptation10.1016/j.promfg.2020.05.149 ↗
6. Domain Adversarial Transfer Network for Cross-domain Fault Diagnosis of Rotary Machinery10.1109/TIM.2020.2995441 ↗
7. Deep Convolution Domain-adversarial Transfer Learning for Fault Diagnosis of Rolling Bearings10.1016/j.measurement.2020.108339 ↗
8. Gear fault diagnosis based on deep learning and subdomain adaptation
9. ARFace: Attention-aware and regularization for face recognition with reinforcement learning10.1109/TBIOM.2021.3104014 ↗
10. Quadratic polynomial guided fuzzy C-means and dual attention mechanism for medical image segmentation10.1016/j.displa.2021.102106 ↗
11. JWSAA: Joint weak saliency and attention aware for person re-identification10.1016/j.neucom.2020.05.106 ↗
12. Remaining useful life prediction of bearings with different failure types based on multi-feature and deep convolution transfer learning10.17531/ein.2021.4.11 ↗
13. Li, X., Zhang, K., Li, W., Feng, Y., and Liu, R. (2022). A Two-Stage Transfer Regression Convolutional Neural Network for Bearing Remaining Useful Life Prediction. Machines, 10.10.3390/machines10050369 ↗
14. A sparse domain adaption network for remaining useful life prediction of rolling bearings under different working conditions10.1016/j.ress.2021.108259 ↗
15. Joint training of a predictor network and a generative adversarial network for time series forecasting: A case study of bearing prognostics10.1016/j.eswa.2022.117415 ↗
16. A Novel Hyperspectral Image Classification Model Using Bole Convolution with Three-Directions Attention Mechanism: Small sample and Unbalanced Learning
17. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention Is All You Need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
18. Bearing fault detection and fault size estimation using fiber-optic sensors10.1016/j.ymssp.2018.10.035 ↗
19. Finite element simulation of subsurface initiated damage from non-metallic inclusions in gearbox bearings10.1016/j.ijfatigue.2019.105347 ↗
20. A new method of bearing life prediction based on feature clustering and evaluation
21. A novel prediction network for remaining useful life of rotating machinery10.1007/BF01177178 ↗
22. A new deep auto-encoder method with fusing discriminant information for bearing fault diagnosis10.1016/j.ymssp.2020.107233 ↗
23. Nectoux, P., Gouriveau, R., Medjaher, K., Ramasso, E., Chebel-Morello, B.P., Zerhouni, N., and Varnier, C. (2012, January 18). PRONOSTIA: An experimental platform for bearings accelerated degradation tests. Proceedings of the IEEE International Conference on Prognostics and Health Management, Denver, CO, USA.
24. XJTU-SY Bearing Datasets10.3901/JME.2019.13.001 ↗
25. Guo, C., Deng, Y., Zhang, C., and Deng, C. (2021, January 18). Remaining Useful Life Prediction of Bearing Based on Autoencoder-LSTM. Proceedings of the International Conference on Mechanical Engineering, Measurement Control, and Instrumentation (MEMCI 2021), Guangzhou, China.10.1117/12.2611404 ↗