journal article·2023-05-07Open access

Research on Insulator Defect Detection Based on Improved YOLOv7 and Multi-UAV Cooperative System

Rong Chang, Shuai Zhou, Yi Zhang, Nanchuan Zhang, Chengjiang Zhou, Mengzhen Li

Coatings· Volume 13· Issue 5

Abstract

Insulator self-blasts, cracked insulators, and bird nests often lead to large-scale power outages and safety accidents, while the detection system based on a single UAV and YOLOv7 is difficult to meet the speed and accuracy requirements in actual detection. Therefore, a novel insulator defect detection method based on improved YOLOv7 and a multi-UAV collaborative system is proposed innovatively. Firstly, a complete insulator defects dataset is constructed, and the introduction of insulator self-blasts, cracked insulators, and bird nest images avoids the problem of low reliability for single defect detection. Secondly, a multi-UAV collaborative platform is proposed, which improves the search scope and efficiency. Most critically, an improved YOLOv7-C3C2-GAM is proposed. The introduction of the C3C2 module and the CNeB2 structure improves the efficiency and accuracy of feature extraction, and the introduction of a global attention mechanism (GAM) improved the feature extraction ability to extract key information about small targets or occluded targets and feature in the region of interest. Compared with YOLOv7, the accuracies of YOLOv7-C3C2 and YOLOv7-C3C2-GAM are improved by 1.3% and 0.5%, respectively, the speed of YOLOv7-C3C2 is improved by 0.1 ms, and the lightweight sizes are reduced by 8.2 Mb and 8.1 Mb, respectively. Therefore, the proposed method provides theoretical and technical support for power equipment defect detection.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Industrial Vision Systems and Defect Detection · Image Enhancement Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Yuxi Power Supply Bureau, Yunnan Power Grid Corporation, Yuxi 653100, China

The Laboratory of Pattern Recognition and Artificial Intelligence, Yunnan Normal University, Kunming 650500, China

Electric Power Research Institute, Yunnan Power Grid Corporation, Kunming 650214, China

School of Information Science and Technology, Yunnan Normal University, Kunming 650500, China

Funding

Science and technology project of China Southern Power Grid Co., Ltd. · Yunnan Normal University

References (40)

Show source-provided references
1. Inspection and identification of transmission line insulator breakdown based on deep learning using aerial images10.1016/j.epsr.2022.108199 ↗
2. Faster R-Transformer: An efficient method for insulator detection in complex aerial environments10.1016/j.measurement.2022.111238 ↗
3. Insulator defect detection: A detection method of target search and cascade recognition10.1016/j.egyr.2021.09.197 ↗
4. Bidirection-Fusion-YOLOv3: An improved method for insulator defect detection using uav image10.1109/TIM.2022.3201499 ↗
5. Automatic detection, classification and localization of defects inlargephotovoltaic plants using unmanned aerial vehicles (UAV) based infrared (IR) and RGB imaging10.1016/j.enconman.2022.116495 ↗
6. Hybrid-YOLO for classification of insulators defects in transmission lines based on UAV10.1016/j.ijepes.2023.108982 ↗
7. Real-time detection of cracks in tiled sidewalks using YOLO-based method applied to unmanned aerial vehicle (UAV) images10.1016/j.autcon.2023.104745 ↗
8. Road damage detection using UAV images based on multi-level attention mechanism10.1016/j.autcon.2022.104613 ↗
9. Development of fault diagnosis for nuclear power plant using deep learning and infrared sensor equipped UAV10.1016/j.anucene.2022.109577 ↗
10. Convolutional neural-network-based automatic dam-surface seepage defect identification from thermograms collected from UAV-mounted thermal imaging camera10.1016/j.conbuildmat.2022.126416 ↗
11. Research on edge intelligent recognition method oriented to transmission line insulator fault detection10.1016/j.ijepes.2022.108054 ↗
12. Insulator detection and damage identification based on improved lightweight YOLOv4 network10.1016/j.egyr.2021.10.039 ↗
13. Uncertainty-aware accurate insulator fault detection based on an improved YOLOX model10.1016/j.egyr.2022.09.195 ↗
14. Insulator defect detection for power grid based on light correction enhancement and YOLOv5 model10.1016/j.egyr.2022.08.027 ↗
15. Zheng, J., Wu, H., Zhang, H., Wang, Z., and Xu, W. (2022). Insulator-defect detection algorithm based on improved YOLOv7. Sensors, 22.10.3390/s22228801 ↗
16. An method for power lines insulator defect detection with attention feedback and double spatial pyramid10.1016/j.epsr.2023.109175 ↗
17. Identification method of typical defects in transmission lines based on YOLOv5 object detection algorithm10.1016/j.egyr.2023.04.078 ↗
18. An insulator self-blast detection method based on YOLOv4 with aerial images10.1016/j.egyr.2021.11.115 ↗
19. Lightweight algorithm of insulator identification applicable to electric power engineering10.1016/j.egyr.2022.01.209 ↗
20. Fault diagnosis method of substation equipment based on You Only Look Once algorithm and infrared imaging10.1016/j.egyr.2022.05.074 ↗
21. Satheeswari, D., Shanmugam, L., and Swaroopan, N.M.J. (2022, January 16–18). Recognition of Bird’s Nest in High Voltage Power Line using SSD. Proceedings of the 2022 First International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT), Trichy, India.10.1109/ICEEICT53079.2022.9768651 ↗
22. RCNN-based foreign object detection for securing power transmission lines (RCNN4SPTL)10.1016/j.procs.2019.01.232 ↗
23. Improved YOLOX Foreign Object Detection Algorithm for Transmission Lines10.1155/2022/5835693 ↗
24. A Lightweight YOLOv4-EDAM Model for Accurate and Real-time Detection of Foreign Objects Suspended On Power Lines
25. Recognition of Bird Nests on Power Transmission Lines in Aerial Images Based on Improved YOLOv410.3389/fenrg.2022.870253 ↗
26. Foreign Object Detection of Electric Transmission Line with Dynamic Federated Learning10.1088/1755-1315/791/1/012159 ↗
27. Pan, L., Chen, L., Zhu, S., Tong, W., and Guo, L. (2022). Research on small sample data-driven inspection technology of uav for transmission line insulator defect detection. Information, 13.10.3390/info13060276 ↗
28. Ma, Y., Li, Q., Chu, L., Zhou, Y., and Xu, C. (2021). Real-time detection and spatial localization of insulators for UAV inspection based on binocular stereo vision. Remote Sens., 13.10.3390/rs13020230 ↗
29. SwinFusion: Cross-domain long-range learning for general image fusion via swin transformer10.1109/JAS.2022.105686 ↗
30. Intelligent fault detection of high voltage line based on the Faster R-CNN10.1016/j.measurement.2019.01.072 ↗
31. Faster r-cnn: Towards real-time object detection with region proposal networks
32. Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (November, January 27). Centernet: Keypoint triplets for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
33. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.
34. Tian, Z., Shen, C., Chen, H., and He, T. (November, January 27). Fcos: Fully convolutional one-stage object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
35. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
36. Gong, H., Mu, T., Li, Q., Dai, H., Li, C., He, Z., Wang, W., Han, F., Tuniyazi, A., and Li, H. (2022). Swin-Transformer-Enabled YOLOv5 with attention mechanism for small object detection on satellite images. Remote Sens., 14.10.3390/rs14122861 ↗
37. Zhu, M., Hu, G., Zhou, H., Wang, S., Feng, Z., and Yue, S. (2022). A ship detection method via redesigned FCOS in large-scale sar images. Remote Sens., 14.10.3390/rs14051153 ↗
38. CEAM-YOLOv7: Improved YOLOv7 based on channel expansion and attention mechanism for driver distraction behavior detection10.1109/ACCESS.2022.3228331 ↗
39. Jiang, K., Xie, T., Yan, R., Wen, X., Li, D., Jiang, H., Jiang, N., Feng, L., Duan, X., and Wang, J. (2022). An attention mechanism-improved YOLOv7 object detection algorithm for hemp duck count estimation. Agriculture, 12.10.3390/agriculture12101659 ↗
40. Multi-UAV cooperative system for search and rescue based on YOLOv510.1016/j.ijdrr.2022.102972 ↗