journal article·2024-09-02Open access

Method for Remaining Useful Life Prediction of Turbofan Engines Combining Adam Optimization-Based Self-Attention Mechanism with Temporal Convolutional Networks

Hairui Wang, Dongjun Li, Ya Li, Guifu Zhu, Rongxiang Lin

Applied Sciences· Volume 14· Issue 17

Abstract

Conducting the remaining useful life (RUL) prediction for an aircraft engines is of significant importance in enhancing aircraft operation safety and formulating reasonable maintenance plans. Addressing the issue of low prediction model accuracy due to traditional neural networks’ inability to fully extract key features, this paper proposes an engine RUL prediction model based on the adaptive moment estimation (Adam) optimized self-attention mechanism–temporal convolutional network (SAM-TCN) neural network. Firstly, the raw data monitored by sensors are normalized, and RUL labels are set. A sliding window is utilized for overlapping sampling of the data, capturing more temporal features while eliminating data dimensionality. Secondly, the SAM-TCN neural network prediction model is constructed. The temporal convolutional network (TCN) neural network is used to capture the temporal dependency between data, solving the mapping relationship of engine degradation characteristics. A self-attention mechanism (SAM) is employed to adaptively assign different weight contributions to different input features. In the experiments, the root mean square error (RMSE) values on four datasets are 11.50, 16.45, 11.62, and 15.47 respectively. These values indicate further reduction in errors compared to methods reported in other literature. Finally, the SAM-TCN prediction model is optimized using the Adam optimizer to improve the training effectiveness and convergence speed of the model. Experimental results demonstrate that the proposed method can effectively learn feature data, with prediction accuracy superior to other models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Technical Engine Diagnostics and Monitoring · Machine Fault Diagnosis Techniques · Tribology and Lubrication Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650504, China

Information Technology Construction Management Center, Kunming University of Science and Technology, Kunming 650504, China

Funding

National Natural Science Foundation of China

References (39)

Show source-provided references
1. A multimodal and hybrid deep neural network model for Remaining Useful Life estimation10.1016/j.compind.2019.02.004 ↗
2. Remaining useful life prediction of aircraft engine based on degradation pattern learning10.1016/j.ress.2017.02.007 ↗
3. Remaining Useful Life Prediction of Turbofan Engine Based on SAE-SA-1D-CNN-BGRU
4. Prediction of remaining useful life of multi-stage aero-engine based on clustering and LSTM fusion10.1016/j.ress.2021.107807 ↗
5. Wang, W. (2023). Life Prediction Based on Historical Data of Aircraft Engines. [Master’s Thesis, Anhui University of Science and Technology]. Available online: https://kns.cnki.net/kcms2/article/abstract?v=sAMp-nZqXjwZCYfF-REwGuLAbZdXvzQDm2VfwUt_kLb3ZD1aDccK5FA4yn1fKiANeKFHsppVnA4Jb00RiYUURZtimcsCir0bAp5_ldutDjaHXX0erC4bNF01UyxiJohgQPsfu0pgLTl26eP8FKNMgrIK6SEfognrcBlWDCazg82D0SwEJTo91uH72pQd_xGzXwUabLZLGLM=&uniplatform=NZKPT&language=CHS.
6. Spatio-temporal fusion attention: A novel approach for remaining useful life prediction based on graph neural network10.1109/TIM.2022.3184352 ↗
7. A Data-Driven Aero-Engine Degradation Prognostic Strategy10.1109/TCYB.2019.2938244 ↗
8. Direct remaining useful life estimation based on support vector regression10.1109/TIE.2016.2623260 ↗
9. Chadza, T., Kyriakopoulos, K.G., and Lambotharan, S. (2019, January 26–28). Contemporary sequential network attacks predict-ion using hidden Markov model. Proceedings of the 2019 17th International Conference on Privacy, Security and Trust (PST), Fredericton, NB, Canada.10.1109/PST47121.2019.8949035 ↗
10. A probabilistic Bayesian recurrent neural network for remaining useful life prognostics considering epistemic and aleatory uncertainties10.1002/stc.2811 ↗
11. Sateesh Babu, G., Zhao, P., and Xiao, L. (2016, January 16–19). Deep convolutional neural network based regression approach for estimation of remaining useful life. Proceedings of the International Conference on Database Systems for Advanced Applications, Dallas, TX, USA.10.1007/978-3-319-32025-0_14 ↗
12. Long short-term memory for machine remaining life prediction10.1016/j.jmsy.2018.05.011 ↗
13. Remaining Useful Life Prediction of Aeroengine Based on Principal Component Analysis and One-Dimensional Convolutional Neural Network
14. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv.
15. Huang, J. (2023). Research and Implementation of Industrial Time Series Analysis Method Based on Machine Learning. [Master’s Thesis, Civil Aviation Flight University of China].
16. MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction10.1016/j.ress.2023.109696 ↗
17. SG-GAN: Adversarial Self-Attention GCN for Point Cloud Topological Parts Generation10.1109/TVCG.2021.3069195 ↗
18. Ye, Q. (2021). Research on Maintenance Decision-making of Turbofan Engines Based on Attention-based Temporal Convolutional Network and Evolutionary Game. [Master’s Thesis, Huazhong University of Science and Technology].
19. Global attention mechanism based deep learning for remaining useful life prediction of aero-engine10.1016/j.measurement.2023.113098 ↗
20. Attention-based LSTM network for rotatory machineremaining useful life prediction
21. Zhang, G. (2022). Rolling Bearing Life Prediction Based on Temporal Convolutional Network. [Master’s Thesis, Nanjing University of Aeronautics and Astronautics].
22. Chiller fault diagnosis based on combination of multiblock and self-attention TCN
23. Genetically optimized prediction of remaining useful life
24. Lu, Y. (2022). Prediction of Residual Life of Gearbox Bearing of Off shore Wind Turbine. [Master’s Thesis, Jiangsu University of Science and Technology].
25. Advances and limitations in machine learning approaches applied to remaining useful life predictions: A critical review10.1007/s00170-024-14000-0 ↗
26. Remaining Useful Life Prediction of Turbofan Engine Using Hybrid Model Based on Autoencoder and Bidirectional Long Short-Term Memory10.1007/s12204-018-2027-5 ↗
27. Remaining Useful Life Prediction of Turbofan Engines Using CNN-LSTM-SAM Approach10.1109/JSEN.2023.3261874 ↗
28. Temporal convolution network based on attention mechanism for well production prediction10.1016/j.petrol.2022.111043 ↗
29. Saxena, A., Goebel, K., Simon, D., and Eklund, N. (2008, January 6–9). Damage propagation modeling for aircraft engine run-to-failure simulation. Proceedings of the 2008 International Conference on Prognostics and Health Management, Denver, CO, USA.10.1109/PHM.2008.4711414 ↗
30. Shi, G. (2022). Research on Data-Driven Aero-Engine RUL Prediction Model. [Master’s Thesis, Dalian University of Technology].
31. Wang, H., Ye, X., Li, Y., and Zhu, G. (2023). Remaining Useful Life Prediction for Lithium-Ion Batteries Based on Improved Mode Decomposition and Time Series. Sustainability, 15.10.3390/su15129176 ↗
32. Wang, H., Li, D., Li, D., Liu, C., Yang, X., and Zhu, G. (2023). Remaining Useful Life Prediction of Aircraft Turbofan Engine Based on Random Forest Feature Selection and Multi-Layer Perceptron. Appl. Sci., 13.10.3390/app13127186 ↗
33. Application of SSA-TCN in Prediction of Remaining Useful Life of Turbofan Engine
34. Rounak, B., and Manikandan, J. (2021, January 3–4). Prediction of Remaining Useful Life for Aero-Engines. Proceedings of the 2021 IEEE International Conference on Aerospace Electronics and Remote Sensing Technology (ICARES), Bali, Indonesia.
35. Sun, J., Zheng, L., Huang, Y., and Ge, Y. (2022, January 16–18). Remaining Useful Life Prediction Based on CNN-BGRU-SA. Proceedings of the 2022 International Conference on Electronics Technology and Artificial Intelligence (ETAI 2022), Chongqing, China.
36. Trend attention fully convolutional network for remaining useful life estimation10.1016/j.ress.2022.108590 ↗
37. Machine remaining life prediction based on multi-layer self-attention and temporal convolution network10.1007/s40747-021-00606-4 ↗
38. Prediction method for mechanical equipment based on RCNN-A BiLSTM
39. Channel attention & temporal attention based temporal convolutional network: A dual attention framework for remaining useful life prediction of the aircraft engines10.1016/j.aei.2024.102372 ↗