Defects Detection on 110 MW AC Wind Farm’s Turbine Generator Blades Using Drone-Based Laser and RGB Images with Res-CNN3 Detector
Source abstract
Abstract
An effective way to perform maintenance on the wind turbine generator (WTG) blades installed in grid-connected wind farms is to inspect them using Unmanned Aerial Vehicles (UAV). The ability to detect wind turbine blade defects from these laser and RGB images captured by drones has been the subject of numerous studies. The issue that most applied techniques battle with is being able to locate different wind turbine blade defects with high confidence scores and precision. The accuracy of these models’ defect detection decreases due to varying testing image scales. This article proposes the Res-CNN3 technique for detecting wind turbine blade defects. In Res-CNN3, defect region detection is achieved through a bipartite process that processes the laser delta and RGB delta structure of a wind turbine blade image with an integration of residual networks and concatenated CNNs to determine the presence of typical defect regions in the image. The loss function is logistic regression, and a Selective Search (SS) algorithm is used to predict the regions of interest (RoI) of the input images for defects detection. Several experiments are conducted, and the outcomes prove that the proposed model has a high prospect for accuracy in solving the problem of defect detection in a manner similar to the advanced benchmark methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Remote Sensing and LiDAR Applications · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Electrical and Electronic Engineering Science Department, University of Johannesburg, Johannesburg 2006, South Africa
Funding
South African Space Agency (SANSA)
References (29)
Show source-provided references
1. Infrared navigation—Part I: An assessment of feasibility
2. A Novel Deep Class-Imbalanced Semisupervised Model for Wind Turbine Blade Icing Detection10.1109/TNNLS.2021.3102514 ↗
3. Moreno, S., Peña, M., Toledo, A., Treviño, R., and Ponce, H. (2018, January 5–7). A New Vision-Based Method Using Deep Learning for Damage Inspection in Wind Turbine Blades. Proceedings of the 2018 15th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE), Mexico City, Mexico.10.1109/ICEEE.2018.8533924 ↗
4. Wind turbine blade breakage monitoring with deep autoencoders10.1109/TSG.2016.2621135 ↗
5. Parlange, R. (2019, January 22–23). Vision-based autonomous navigation for wind turbine inspection using an unmanned aerial vehicle. Proceedings of the 10th International Micro-Air Vehicles Conference, Melbourne, Australia.
6. Gu, W., Hu, D., Cheng, L., Cao, Y., Rizzo, A., and Valavanis, K.P. (2020, January 1–4). Autonomous Wind Turbine Inspection using a Quadrotor. Proceedings of the 2020 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece.10.1109/ICUAS48674.2020.9214066 ↗
7. Moolan-Feroze, O., Karachalios, K., Nikolaidis, D.N., and Calway, A. (2019, January 20–24). Improving drone localisation around wind turbines using monocular model-based tracking. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8794156 ↗
8. Guo, H., Cui, Q., Wang, J., Fang, X., Yang, W., and Li, Z. (August, January 28). Detecting and positioning of wind turbine blade tips for uav-based automatic inspection. Proceedings of the IGARSS 2019–2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.10.1109/IGARSS.2019.8899827 ↗
9. Autonomous and scalable control for remote inspection with multiple aerial vehicles10.1016/j.robot.2016.10.012 ↗
10. Inside Unmanned Systems (2015). Cyberhawk Announces Wind Turbine Inspection Service, Inside Unmanned Systems.
11. Mishnaevsky, L. (2022). Root Causes and Mechanisms of Failure of Wind Turbine Blades: Overview. Materials, 15.10.3390/ma15092959 ↗
12. Wang, W., Xue, Y., He, C., and Zhao, Y. (2023, March 05). Defect Types and Mechanism of Wind Turbine Blades. Encyclopedia. Available online: https://encyclopedia.pub/entry/27751.
13. Encapsulant adhesion to surface metallization on photovoltaic cells10.1109/JPHOTOV.2017.2746572 ↗
14. Corrosion influence on safety of hydraulic pipelines installed on decks of contemporary product and chemical tankers10.2478/pomr-2018-0056 ↗
15. Edge-Computing-Enabled Unmanned Module Defect Detection and Diagnosis System for Large-Scale Photovoltaic Plants10.1109/JIOT.2020.2983723 ↗
16. Selective search for object recognition10.1007/s11263-013-0620-5 ↗
17. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
18. (2019). Wind Energy Generation Systems—Part 1: Design Requirement (Standard No. IEC 61400-1:2019).
19. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
20. Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv.
21. Inner-Imaging Networks: Put Lenses Into Convolutional Structure10.1109/TCYB.2020.3034605 ↗
22. Zagoruyko, S., and Komodakis, N. (2016, January 19–22). Wide residual networks. Proceedings of the BMVC, York, UK.10.5244/C.30.87 ↗
23. Han, D., Kim, J., and Kim, J. (2017, January 21–26). Deep pyramidal residual networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.668 ↗
24. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
25. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, S., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
26. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
27. Botev, A., Lever, G., and Barber, D. (2017, January 14–19). Nesterov’s accelerated gradient and momentum as approximations to regularised update descent. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.10.1109/IJCNN.2017.7966082 ↗
28. Research on small target detection in driving scenarios based on improved YOLO network10.1109/ACCESS.2020.2966328 ↗
29. 75MW AC PV Module Field Anomaly Detection Using Drone-Based IR Orthogonal Images With Res-CNN3 Detector10.1109/ACCESS.2022.3194547 ↗