Remaining Useful Life Estimation of Turbofan Engines with Deep Learning Using Change-Point Detection Based Labeling and Feature Engineering
Source abstract
Abstract
Accurate remaining useful life (RUL) prediction is one of the most challenging problems in the prognostics of turbofan engines. Recently, RUL prediction methods for turbofan engines mainly involve data-driven models. Preprocessing the sensor data is essential for the performance of the prognostic models. Most studies on turbofan engines use piecewise linear (PwL) labeling, which starts with a constant initial RUL value in normal/healthy operating time. In this study, we designed a prognostic procedure that includes difference-based feature construction, change-point-detection-based PwL labeling, and a 1D-CNN-LSTM (one-dimensional–convolutional neural network–long short-term memory) hybrid neural network model for RUL prediction. The procedure was evaluated on the subset FD001 of the C-MAPSS dataset. The proposed procedure was compared with machine learning and deep learning models with and without the new difference feature. Also, the results were compared with the studies that used similar labeling approaches. Our analysis of the numerical results underscores the clear superiority of the proposed 1D-CNN-LSTM model with the difference feature in RUL prediction, with a score of 437.2 and an RMSE value of 16.1. This result illustrates the superior predictive capability of the 1D-CNN-LSTM model, which outperformed traditional machine learning methods and one of the earliest deep learning methods. These findings emphasize the superior predictive capability of the 1D-CNN-LSTM model and underline the potential of the feature engineering process for more accurate and robust RUL prediction in the context of turbofan engine prognostics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Combustion Engine Technologies · Advanced Aircraft Design and Technologies · Machine Fault Diagnosis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Industrial Engineering, Faculty of Engineering, Bursa Uludağ University, Bursa 16059, Türkiye
Department of Industrial Engineering, Faculty of Engineering, Yalova University, Yalova 77200, Türkiye
References (71)
Show source-provided references
1. Peng, C., Chen, Y., Chen, Q., Tang, Z., Li, L., and Gui, W. (2021). A remaining useful life prognosis of turbofan engine using temporal and spatial feature fusion. Sensors, 21.10.3390/s21020418 ↗
2. Condition-based maintenance effectiveness for series-parallel power generation system—A combined Markovian simulation model10.1016/j.ress.2015.04.009 ↗
3. Investigating computational geometry for failure prognostics
4. (2015). Condition Monitoring and Diagnostics of Machines—Prognostics—Part 1: General Guidelines (Standard No. ISO 13381-1 2015).
5. Leser, P.E. (2017). Probabilistic Prognostics and Health Management for Fatigue-Critical Components using High-Fidelity Models. [Ph.D. Thesis, North Carolina State University].
6. Remaining useful life estimation—A review on the statistical data-driven approaches10.1016/j.ejor.2010.11.018 ↗
7. Remaining Useful Life Prediction of Turbofan Engine Using Hybrid Model Based on Autoencoder and Bidirectional Long Short-Term Memory10.1007/s12204-018-2027-5 ↗
8. Remaining useful life predictions for turbofan engine degradation based on concurrent semi-supervised model10.1007/s00521-021-06089-1 ↗
9. Remaining useful life estimation in prognostics using deep convolution neural networks10.1016/j.ress.2017.11.021 ↗
10. Direct Remaining Useful Life Estimation Based on Support Vector Regression10.1109/TIE.2016.2623260 ↗
11. Zheng, S., Ristovski, K., Farahat, A., and Gupta, C. (2017, January 19–21). Long Short-Term Memory Network for Remaining Useful Life Estimation. Proceedings of the IEEE International Conference on Prognostics and Health Management, Dallas, TX, USA.10.1109/ICPHM.2017.7998311 ↗
12. Improved trajectory similarity-based approach for turbofan engine prognostics10.1007/s12206-019-0928-3 ↗
13. Remaining useful life estimation based on stochastic deterioration models: A comparative study10.1016/j.ress.2012.11.022 ↗
14. Remaining useful lifetime estimation and noisy gamma deterioration process10.1016/j.ress.2015.12.016 ↗
15. Giantomassi, A., Ferracuti, F., Benini, A., Ippoliti, G., Longhi, S., and Petrucci, A. (2011, January 28–31). Hidden Markov Model for Health Estimation and Prognosis of Turbofan Engines. Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Washington, DC, USA.10.1115/DETC2011-48174 ↗
16. Remaining useful life estimation using a bidirectional recurrent neural network based autoencoder scheme10.1016/j.ymssp.2019.05.005 ↗
17. Heimes, F.O. (2008, January 6–9). Recurrent neural networks for remaining useful life estimation. Proceedings of the International Conference on Prognostics and Health Management, Denver, CO, USA.10.1109/PHM.2008.4711422 ↗
18. Zhao, C., Huang, X., Li, Y., and Iqbal, M.Y. (2020). A double-channel hybrid deep neural network based on CNN and BiLSTM for remaining useful life prediction. Sensors, 20.10.3390/s20247109 ↗
19. Peng, C., Wu, J., Wang, Q., Gui, W., and Tang, Z. (2022). Remaining Useful Life Prediction Using Dual-Channel LSTM with Time Feature and Its Difference. Entropy, 24.10.3390/e24121818 ↗
20. Wang, J., Wen, G., Yang, S., and Liu, Y. (2018, January 26–28). Remaining Useful Life Estimation in Prognostics Using Deep Bidirectional LSTM Neural Network. Proceedings of the Prognostics and System Health Management Conference, Chongqing, China.10.1109/PHM-Chongqing.2018.00184 ↗
21. Data-driven remaining useful life prediction via multiple sensor signals and deep long short-term memory neural network10.1016/j.isatra.2019.07.004 ↗
22. Saxena, A., and Goebel, K. (2023, October 01). Turbofan Engine Degradation Simulation Data Set. NASA Ames Prognostics Data Repository, NASA Ames Research Center, Moffett Field, CA, USA. [Online], Available online: https://data.nasa.gov/Aerospace/CMAPSS-Jet-Engine-Simulated-Data/ff5v-kuh6/.
23. Wang, Y., and Zhao, Y. (2022). Multi-Scale Remaining Useful Life Prediction Using Long Short-Term Memory. Sustainability, 14.10.3390/su142315667 ↗
24. Muneer, A., Taib, S.M., Fati, S.M., and Alhussian, H. (2021). Deep-learning based prognosis approach for remaining useful life prediction of turbofan engine. Symmetry, 13.10.3390/sym13101861 ↗
25. Using temporal convolution network for remaining useful lifetime prediction10.1002/eng2.12305 ↗
26. Remaining Useful Life Prediction Using Temporal Convolution with Attention10.3390/ai2010005 ↗
27. Remaining useful life prediction using multi-scale deep convolutional neural network10.1016/j.asoc.2020.106113 ↗
28. A Spatio-Temporal Attention Mechanism-Based Approach for Remaining Useful Life Prediction of Turbofan Engine10.1155/2022/9707940 ↗
29. A multi-modal and hybrid deep neural network model for remaining useful life estimation10.1016/j.compind.2019.02.004 ↗
30. Kong, Z., Cui, Y., Xia, Z., and Lv, H. (2019). Convolution and long short-term memory hybrid deep neural networks for remaining useful life prognostics. Appl. Sci., 9.10.3390/app9194156 ↗
31. Effective Latent Representation for Prediction of Remaining Useful Life10.32604/csse.2021.014100 ↗
32. Remaining Useful Life Prediction Using a Novel Feature-Attention-Based End-to-End Approach10.1109/TII.2020.2983760 ↗
33. Remaining Useful Life Prediction Based on Multi-sensor Fusion and Attention TCN-BiGRU Model10.1109/JSEN.2022.3208753 ↗
34. Remaining useful life estimation of engineered systems using vanilla LSTM neural networks10.1016/j.neucom.2017.05.063 ↗
35. Remaining useful life prediction based on intentional noise injection and feature reconstruction10.1016/j.ress.2021.107871 ↗
36. Machine Remaining Useful Life Prediction via an Attention-Based Deep-Learning Approach10.1109/TIE.2020.2972443 ↗
37. A recurrent neural network approach for remaining useful life prediction utilizing a novel trend features construction method10.1016/j.measurement.2019.06.004 ↗
38. Learning of physical health timestep using the LSTM network for remaining useful life estimation10.1016/j.ress.2022.108717 ↗
39. Joint Learning of Degradation Assessment and RUL Prediction for Aeroengines via Dual-Task Deep LSTM Networks10.1109/TII.2019.2900295 ↗
40. Health status assessment and remaining useful life prediction of aero-engine based on BiGRU and MMoE10.1016/j.ress.2021.108263 ↗
41. A dual-LSTM framework combining change point detection and remaining useful life prediction10.1016/j.ress.2020.107257 ↗
42. More effective prognostics with elbow point detection and deep learning10.1016/j.ymssp.2020.106987 ↗
43. Anomaly monitoring improves remaining useful life estimation of industrial machinery10.1016/j.jmsy.2020.06.014 ↗
44. Nair, P., Vakharia, V., Borade, H., Shah, M., and Wankhede, V. (2023). Predicting Li-Ion Battery Remaining Useful Life: An XDFM-Driven Approach with Explainable AI. Energies, 16.10.3390/en16155725 ↗
45. Li, J., Huang, F., Qin, H., and Pan, J. (2023). Research on Remaining Useful Life Prediction of Bearings Based on MBCNN-BiLSTM. Appl. Sci., 13.10.3390/app13137706 ↗
46. Sova, J., Kolar, P., Burian, D., and Vozabal, P. (2023). Remaining Useful Life Estimation of Spindle Bearing Based on Bearing Load Calculation and Off-Line Condition Monitoring. Machines, 11.10.3390/machines11060586 ↗
47. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
48. Hong, C.W., Lee, K., Ko, M.S., Kim, J.K., Oh, K., and Hur, K. (2020, January 19–22). Multivariate time series forecasting for remaining useful life of turbofan engine using deep-stacked neural network and correlation analysis. Proceedings of the IEEE International Conference on Big Data and Smart Computing, Busan, Republic of Korea.10.1109/BigComp48618.2020.00-98 ↗
49. Validation of Data-Driven Labeling Approaches Using a Novel Deep Network Structure for Remaining Useful Life Predictions10.1109/ACCESS.2019.2920297 ↗
50. Deep learning10.1038/nature14539 ↗
51. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
52. Autoencoder Based Semi-Supervised Anomaly Detection in Turbofan Engines
53. Zheng, A., and Casari, A. (2018). Feature Engineering for Machine Learning: Principles and Techniques for Data Scientists, O’Reilly. [1st ed.].
54. Gupta, A., Masampally, V.S., Jadhav, V., Deodhar, A., and Runkana, V. (2021, January 21–23). Supervised Operational Change Point Detection using Ensemble Long-Short Term Memory in a Multicomponent Industrial System. Proceedings of the IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI), Herl’any, Slovakia.10.1109/SAMI50585.2021.9378683 ↗
55. Jekel, C., and Venter, G. (2023, October 01). pwlf: A Python Library for Fitting 1D Continuous Piece-Wise Linear Functions. Available online: https://www.researchgate.net/profile/Charles-Jekel-2/publication/331231072_pwlf_A_Python_Library_for_Fitting_1D_Continuous_Piecewise_Linear_Functions/links/5c6d607aa6fdcc404ec03c53/pwlf-A-Python-Library-for-Fitting-1D-Continuous-Piecewise-Linear-Functions.pdf.
56. Zhang, B., Zheng, K., Huang, Q., Feng, S., Zhou, S., and Zhang, Y. (2020). Aircraft Engine Prognostics Based on Informative Sensor Selection and Adaptive Degradation Modeling with Functional Principal Component Analysis. Sensors, 20.10.3390/s20030920 ↗
57. A neural network filtering approach for similarity-based remaining useful life estimation10.1007/s00170-018-2874-0 ↗
58. A novel soft computing method for engine RUL prediction10.1007/s11042-017-5204-x ↗
59. Filters: When, Why, and How (Not) to Use Them10.1016/j.neuron.2019.02.039 ↗
60. Saxena, A., and Goebel, K. (2023, October 01). PHM08 Challenge Data Set. NASA Ames Prognostics Data Repository, NASA Ames Research Center, Moffett Field, CA, USA. [Online], Available online: https://data.nasa.gov/Raw-Data/PHM-2008-Challenge/nk8v-ckry.
61. A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions10.1109/TIE.2019.2891463 ↗
62. Muneer, A., Taib, S.M., Naseer, S., Ali, R.F., and Aziz, I.A. (2021). Data-driven deep learning-based attention mechanism for remaining useful life prediction: Case study application to turbofan engine analysis. Electronics, 10.10.3390/electronics10202453 ↗
63. Causal augmented ConvNet: A temporal memory dilated convolution model for long-sequence time series prediction10.1016/j.isatra.2021.05.026 ↗
64. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. arXiv.
65. Chollet, F., Allaire, J.J., Kalinowski, T., RStudio, Google, Tang, Y., Bijl, W., Studer, M., and Keydana, S. (2023, October 01). Keras. Available online: https://keras.io.
66. Joint Prediction of Continuous and Discrete States in Time-Series Based on Belief Functions10.1109/TSMCB.2012.2198882 ↗
67. Najibi, A., Ghazifard, P., and Torkian, J. (2023). On the crashworthiness optimisation of a new multi-corner tube under axial loading. Ships Offshore Struct., 1–14.10.1080/17445302.2022.2162754 ↗
68. Developing and multi-objective optimization of a combined energy absorber structure using polynomial neural networks and evolutionary algorithms10.1590/1679-78252797 ↗
69. Polynomial Theory of Complex Systems10.1109/TSMC.1971.4308320 ↗
70. Optimal detection of changepoints with a linear computational cost10.1080/01621459.2012.737745 ↗
71. Huang, D., Bai, R., Zhao, S., Wen, P., Wang, S., and Chen, S. (2020, January 8–10). Bayesian neural network based method of remaining useful life prediction and uncertainty quantification for aircraft engine. Proceedings of the Annual Conference of the Prognostics and Health Management Society, Detroit, MI, USA.10.1109/ICPHM49022.2020.9187044 ↗