journal article·2024-08-23Open access

A Novel Data-Driven Approach with a Long Short-Term Memory Autoencoder Model with a Multihead Self-Attention Deep Learning Model for Wind Turbine Converter Fault Detection

Joel Torres-Cabrera, Jorge Maldonado-Correa, Marcelo Valdiviezo-Condolo, Estefanía Artigao, Sergio Martín-Martínez, Emilio Gómez-Lázaro

Applied Sciences· Volume 14· Issue 17

Abstract

The imminent depletion of oil resources and increasing environmental pollution have driven the use of clean energy, particularly wind energy. However, wind turbines (WTs) face significant challenges, such as critical component failures, which can cause unexpected shutdowns and affect energy production. To address this challenge, we analyzed the Supervisory Control and Data Acquisition (SCADA) data to identify significant differences between the relationship of variables based on data reconstruction errors between actual and predicted values. This study proposes a hybrid short- and long-term memory autoencoder model with multihead self-attention (LSTM-MA-AE) for WT converter fault detection. The proposed model identifies anomalies in the data by comparing the reconstruction errors of the variables involved. However, more is needed. To address this model limitation, we developed a fault prediction system that employs an adaptive threshold with an Exponentially Weighted Moving Average (EWMA) and a fixed threshold. This system analyzes the anomalies of several variables and generates fault warnings in advance time. Thus, we propose an outlier detection method through data preprocessing and unsupervised learning, using SCADA data collected from a wind farm located in complex terrain, including real faults in the converter. The LSTM-MA-AE is shown to be able to predict the converter failure 3.3 months in advance, and with an F1 greater than 90% in the tests performed. The results provide evidence of the potential of the proposed model to improve converter fault diagnosis with SCADA data in complex environments, highlighting its ability to increase the reliability and efficiency of WTs.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Fault Diagnosis Techniques · Power System Reliability and Maintenance · Power Systems Fault Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Technological and Energy Research Center (CITE), National University of Loja, Loja 110150, Ecuador

Renewable Energy Research Institute (IIER), University of Castilla-La Mancha, 02071 Albacete, Spain

Funding

the Junta de Comunidades de Castilla-La Mancha · the Spanish Ministry of Economy and Competitiveness and the European Union

References (45)

Show source-provided references
1. Fault Diagnosis Methods Based on Machine Learning and its Applications for Wind Turbines: A Review10.1109/ACCESS.2021.3124025 ↗
2. Bošnjaković, M., Katinić, M., Santa, R., and Marić, D. (2022). Wind Turbine Technology Trends. Appl. Sci., 12.10.3390/app12178653 ↗
3. Hidden Markov model based principal component analysis for intelligent fault diagnosis of wind energy converter systems10.1016/j.renene.2020.01.010 ↗
4. Mishnaevsky, L. (2022). Root Causes and Mechanisms of Failure of Wind Turbine Blades: Overview. Materials, 15.10.3390/ma15092959 ↗
5. Multi-sensor edge computing architecture for identification of failures short-circuits in wind turbine generators10.1016/j.asoc.2020.107053 ↗
6. Broad review of “White Etching Crack” failure in wind turbine gearbox bearings: Main factors and experimental investigations10.1016/j.ijfatigue.2020.106091 ↗
7. Gao, Z., and Liu, X. (2021). An Overview on Fault Diagnosis, Prognosis and Resilient Control for Wind Turbine Systems. Processes, 9.10.3390/pr9020300 ↗
8. A review of failure modes, condition monitoring and fault diagnosis methods for large-scale wind turbine bearings10.1016/j.measurement.2019.107002 ↗
9. Hossain, M.L., Abu-Siada, A., and Muyeen, S.M. (2018). Methods for Advanced Wind Turbine Condition Monitoring and Early Diagnosis: A Literature Review. Energies, 11.10.3390/en11051309 ↗
10. Wind power forecasting for the Villonaco wind farm
11. A state-of-the-art review on wind power converter fault diagnosis10.1016/j.egyr.2022.03.178 ↗
12. A survey of fault diagnosis for onshore grid-connected converter in wind energy conversion systems10.1016/j.rser.2016.08.006 ↗
13. A Survey on Wind Turbine Condition Monitoring and Fault Diagnosis—Part I: Components and Subsystems10.1109/TIE.2015.2422112 ↗
14. Fischer, K., Pelka, K., Puls, S., Poech, M.H., Mertens, A., Bartschat, A., Tegtmeier, B., Broer, C., and Wenske, J. (2019). Exploring the Causes of Power-Converter Failure in Wind Turbines based on Comprehensive Field-Data and Damage Analysis. Energies, 12.10.3390/en12040593 ↗
15. Short-term wind speed forecasting over complex terrain using linear regression models and multivariable LSTM and NARX networks in the Andes Mountains, Ecuador10.1016/j.renene.2021.10.070 ↗
16. Deep Learning for fault detection in wind turbines10.1016/j.rser.2018.09.012 ↗
17. Waqas Khan, P., and Byun, Y.C. (2022). Multi-Fault Detection and Classification of Wind Turbines Using Stacking Classifier. Sensors, 22.10.3390/s22186955 ↗
18. Fault detection of wind turbine based on SCADA data analysis using CNN and LSTM with attention mechanism10.1016/j.measurement.2021.109094 ↗
19. Wind turbine fault detection based on deep residual networks10.1016/j.eswa.2022.119102 ↗
20. Fault Detection of Wind Turbines by Subspace Reconstruction-Based Robust Kernel Principal Component Analysis10.1109/TIM.2021.3127641 ↗
21. Santolamazza, A., Dadi, D., and Introna, V. (2021). A Data-Mining Approach for Wind Turbine Fault Detection Based on SCADA Data Analysis Using Artificial Neural Networks. Energies, 14.10.3390/en14071845 ↗
22. Remaining useful life prediction of rolling bearing based on multi-head attention embedded Bi-LSTM network10.1016/j.measurement.2022.111803 ↗
23. Liu, Z., Xiao, C., Zhang, T., and Zhang, X. (2020). Research on Fault Detection for Three Types of Wind Turbine Subsystems Using Machine Learning. Energies, 13.10.3390/en13020460 ↗
24. Wind turbine fault detection based on the transformer model using SCADA data10.1016/j.engfailanal.2024.108354 ↗
25. Xiao, C., Liu, Z., Zhang, T., and Zhang, X. (2021). Deep Learning Method for Fault Detection of Wind Turbine Converter. Appl. Sci., 11.10.3390/app11031280 ↗
26. A novel unsupervised deep learning approach for vibration-based damage diagnosis using a multi-head self-attention LSTM autoencoder10.1016/j.measurement.2024.114410 ↗
27. Lee, Y., Park, C., Kim, N., Ahn, J., and Jeong, J. (2024). LSTM-Autoencoder Based Anomaly Detection Using Vibration Data of Wind Turbines. Sensors, 24.10.3390/s24092833 ↗
28. Wind turbine fault detection and identification through self-attention-based mechanism embedded with a multivariable query pattern10.1016/j.renene.2023.05.003 ↗
29. Aksan, F., Janik, P., Suresh, V., and Leonowicz, Z. (July, January 28). Review of the application of deep learning for fault detection in wind turbine. Proceedings of the 2022 IEEE International Conference on Environment and Electrical Engineering and 2022 IEEE Industrial and Commercial Power Systems Europe (EEEIC/I&CPS Europe), Prague, Czech Republic.10.1109/EEEIC/ICPSEurope54979.2022.9854770 ↗
30. A fault diagnosis method for wind turbines with limited labeled data based on balanced joint adaptive network10.1016/j.neucom.2022.01.067 ↗
31. Fault Diagnosis of Wind Turbine Power Converter Considering Wavelet Transform, Feature Analysis, Judgment and BP Neural Network10.1109/ACCESS.2019.2958409 ↗
32. Diagnosis of Multiple Open-Circuit Switch Faults Based on Long Short-Term Memory Network for DFIG-Based Wind Turbine Systems10.1109/JESTPE.2019.2908981 ↗
33. Research of artificial intelligence operations for wind turbines considering anomaly detection, root cause analysis, and incremental training10.1016/j.ress.2023.109634 ↗
34. Short-Term Fault Prediction of Wind Turbines Based on Integrated RNN-LSTM10.1109/ACCESS.2024.3364395 ↗
35. Oliveira-Filho, A., Zemouri, R., Cambron, P., and Tahan, A. (2023). Early Detection and Diagnosis of Wind Turbine Abnormal Conditions Using an Interpretable Supervised Variational Autoencoder Model. Energies, 16.10.3390/en16124544 ↗
36. Wind turbine anomaly detection based on SCADA: A deep autoencoder enhanced by fault instances10.1016/j.isatra.2023.03.045 ↗
37. Zhong, Y., Lakshminarayan, S., Ran, L., Mawby, P., Jia, C., and Ng, C. (November, January 29). Detecting Power Module Thermal Resistance Change in Wind Turbine Converters with an Attention-based LSTM-Autoencoder Architecture. Proceedings of the 2023 IEEE Energy Conversion Congress and Exposition (ECCE), Nashville, TN, USA.10.1109/ECCE53617.2023.10362132 ↗
38. Wind Power Resource Assessment in Complex Terrain: Villonaco Case-study Using Computational Fluid Dynamics Analysis10.1016/j.egypro.2016.12.127 ↗
39. Reliability Assessment of Wind Power Converter Considering SCADA Multistate Parameters Prediction Using FP-Growth, WPT, K-Means and LSTM Network10.1109/ACCESS.2020.2992089 ↗
40. Anomaly detection and condition monitoring of wind turbine gearbox based on LSTM-FS and transfer learning10.1016/j.renene.2022.02.061 ↗
41. A Multi-Level-Denoising Autoencoder Approach for Wind Turbine Fault Detection10.1109/ACCESS.2019.2914731 ↗
42. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
43. Chen, P.C., Tsai, H., Bhojanapalli, S., Chung, H.W., Chang, Y.W., and Ferng, C.S. (2021). A Simple and Effective Positional Encoding for Transformers. arXiv, Available online: http://arxiv.org/abs/2104.08698.10.18653/v1/2021.emnlp-main.236 ↗
44. Enhancing the performance of EWMA charts10.1002/qre.1175 ↗
45. An Integrated Ensemble Learning Model for Imbalanced Fault Diagnostics and Prognostics10.1109/ACCESS.2018.2807121 ↗