journal article·2024-09-28Open access

DCW-YOLO: An Improved Method for Surface Damage Detection of Wind Turbine Blades

Li Zou, Anqi Chen, Chunzi Li, Xinhua Yang, Yibo Sun

Applied Sciences· Volume 14· Issue 19

Abstract

Wind turbine blades (WTBs) are prone to damage from their working environment, including surface peeling and cracks. Early and effective detection of surface defects on WTBs can avoid complex and costly repairs and serious safety hazards. Traditional object detection methods have disadvantages of insufficient detection capabilities, extended model inference times, low recognition accuracy for small objects, and elongated strip defects within WTB datasets. In light of these challenges, a novel model named DCW-YOLO for surface damage detection of WTBs is proposed in this research, which leverages image data collected by unmanned aerial vehicles (UAVs) and the YOLOv8 algorithm for image analysis. Firstly, Dynamic Separable Convolution (DSConv) is introduced into the C2f module of YOLOv8, allowing the model to more effectively focus on the geometric structural details associated with damage on WTBs. Secondly, the upsampling method is replaced with the content-aware reassembly of features (CARAFE), which significantly minimizes the degradation of image characteristics throughout the upsampling process and boosts the network’s ability to extract features. Finally, the loss function is substituted with the WIoU (Wise-IoU) strategy. This strategy allows for a more accurate regression of the target bounding boxes and helps to improve the reliability in the localization of WTBs damages, especially for low-quality examples. This model demonstrates a notable superiority in surface damage detection of WTBs compared to the original YOLOv8n and has achieved a substantial improvement in the mAP@0.5 metric, rising from 91.4% to 93.8%. Furthermore, in the more rigorous mAP@0.5–0.95 metric, it has also seen an increase from 68.9% to 71.2%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Structural Health Monitoring Techniques · Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Intelligent Rail Engineering, Dalian Jiaotong University, Dalian 116028, China

Liaoning Key Laboratory of Welding and Reliability of Rail Transportation Equipment, Dalian Jiaotong University, Dalian 116028, China

School of Chinese Language and Literature, Tangshan Normal University, Tangshan 063000, China

Funding

National Natural Science Foundation of China · Applied Basic Research Program Project of Liaoning Province

References (49)

Show source-provided references
1. Renewable energy and sustainable development: A crucial review10.1016/S1364-0321(99)00011-8 ↗
2. Global Wind Energy Council (2023, May 06). Global Wind Report 2023. Available online: https://gwec.net/globalwindreport2023.
3. Damage detection techniques for wind turbine blades: A review10.1016/j.ymssp.2019.106445 ↗
4. Optimisation of wind turbine blades10.1016/j.jmatprotec.2005.06.055 ↗
5. Mishnaevsky, L. (2022). Root causes and mechanisms of failure of wind turbine blades: Overview. Materials, 15.10.3390/ma15092959 ↗
6. Recent advances in damage detection of wind turbine blades: A state-of-the-art review10.1016/j.rser.2022.112723 ↗
7. Key challenges and prospects for large wind turbines10.1016/j.rser.2015.09.080 ↗
8. Study on crack monitoring method of wind turbine blade based on AI model: Integration of classification, detection, segmentation and fault level evaluation10.1016/j.renene.2024.120152 ↗
9. Wind turbine fault detection based on deep residual networks10.1016/j.eswa.2022.119102 ↗
10. A damage detection system for inner bore of electromagnetic railgun launcher based on deep learning and computer vision10.1016/j.eswa.2022.117351 ↗
11. A hybrid prototype selection-based deep learning approach for anomaly detection in industrial machines10.1016/j.eswa.2022.117528 ↗
12. Faster r-cnn: Towards real-time object detection with region proposal networks
13. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
14. Ssd: Single shot multibox detector10.1007/978-3-319-46448-0_2 ↗
15. Vibration-based experimental damage detection of a small-scale wind turbine blade10.1177/1475921716663876 ↗
16. Structural health monitoring techniques for wind turbine blades10.1016/S0167-6105(99)00132-4 ↗
17. Vibration analysis for large-scale wind turbine blade bearing fault detection with an empirical wavelet thresholding method10.1016/j.renene.2019.06.094 ↗
18. Kumpati, R., Skarka, W., and Ontipuli, S.K. (2021). Current trends in integration of nondestructive testing methods for engineered materials testing. Sensors, 21.10.3390/s21186175 ↗
19. An experimental study of acoustic emission methodology for in service condition monitoring of wind turbine blades10.1016/j.renene.2016.06.048 ↗
20. Damage mode identification and singular signal detection of composite wind turbine blade using acoustic emission10.1016/j.compstruct.2020.112954 ↗
21. Testing, inspecting and monitoring technologies for wind turbine blades: A survey10.1016/j.rser.2012.12.056 ↗
22. Damage detection in a laboratory wind turbine blade using techniques of ultrasonic NDT and SHM10.1111/str.12290 ↗
23. Ultrasound-based identification of damage in wind turbine blades using novelty detection10.1016/j.ultras.2020.106166 ↗
24. Measurements on rotating blades using IR thermography10.1016/j.expthermflusci.2007.05.002 ↗
25. Sanati, H., Wood, D., and Sun, Q. (2018). Condition monitoring of wind turbine blades using active and passive thermography. Appl. Sci., 8.10.3390/app8102004 ↗
26. Remote inspection of internal delamination in wind turbine blades using continuous line laser scanning thermography10.1007/s40684-020-00192-9 ↗
27. Research on crack detection method of wind turbine blade based on a deep learning method10.1016/j.apenergy.2022.120241 ↗
28. A Method for Solving Path Planning Problems in Complex Scenarios
29. Damage identification of wind turbine blades with deep convolutional neural networks10.1016/j.renene.2021.04.040 ↗
30. Image recognition of wind turbine blade damage based on a deep learning model with transfer learning and an ensemble learning classifier10.1016/j.renene.2020.08.125 ↗
31. Efficient and Accurate Damage Detector for Wind Turbine Blade Images10.1109/ACCESS.2022.3224446 ↗
32. Surface Defect Detection of Wind Turbine Based on Lightweight YOLOv5s Model10.1016/j.measurement.2023.113222 ↗
33. An Improved Algorithm for Wind Turbine Blade Defect Detection10.1109/ACCESS.2022.3216613 ↗
34. Hu, Y., Wang, L., Kou, T., and Zhang, M. (2023, January 21–23). YOLO-Tiny-attention: An Improved Algorithm for Fault Detection of Wind Turbine Blade. Proceedings of the 2023 8th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi’an, China.10.1109/ICSP58490.2023.10248560 ↗
35. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 18–22). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
36. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2021, January 19–25). Scaled-yolov4: Scaling cross stage partial network. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual Event.10.1109/CVPR46437.2021.01283 ↗
37. Parallel FPN algorithm based on cascade R-CNN for object detection from UAV aerial images10.3788/LOP57.201505 ↗
38. Symposium Title: The Fronto-Parietal Network (FPN): Supporting a Top-Down Control of Executive Functioning10.1016/j.ijpsycho.2021.07.115 ↗
39. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv.
40. Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection
41. Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 7–12). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6999 ↗
42. Feng, C., Zhong, Y., Gao, Y., Scott, M.R., and Huang, W. (2021, January 11–17). Tood: Task-aligned one-stage object detection. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV) IEEE Computer Society, Montreal, QC, Canada, (Virtual Event).10.1109/ICCV48922.2021.00349 ↗
43. Qi, Y., He, Y., Qi, X., Zhang, Y., and Yang, G. (2023, January 2–6). Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00558 ↗
44. Wang, J., Chen, K., Xu, R., Liu, Z., Loy, C.C., and Lin, D. (November, January 27). Carafe: Content-aware reassembly of features. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
45. Tong, Z., Chen, Y., Xu, Z., and Yu, R. (2023). Wise-IoU: Bounding Box Regression Loss with Dynamic Focusing Mechanism. arXiv.
46. Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A single-stage object detection framework for industrial applications. arXiv.
47. Wang, C.Y., Yeh, I.H., and Liao, H.Y.M. (2024). YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information. arXiv.
48. Wang, A., Chen, H., Liu, L., Chen, K., Lin, Z., Han, J., and Ding, G. (2024). Yolov10: Real-time end-to-end object detection. arXiv.
49. Lv, W., Xu, S., Zhao, Y., Wang, G., Wei, J., Cui, C., Du, Y., Dang, Q., and Liu, Y. (2023). Detrs beat yolos on real-time object detection. arXiv.