journal article·2022-01-24Open access

Detection of Transmission Line Insulator Defects Based on an Improved Lightweight YOLOv4 Model

Zhibin Qiu, Xuan Zhu, Caibo Liao, Dazhai Shi, Wenqian Qu

Applied Sciences· Volume 12· Issue 3

Abstract

Defective insulators seriously threaten the safe operation of transmission lines. This paper proposes an insulator defect detection method based on an improved YOLOv4 algorithm. An insulator image sample set was established according to the aerial images from the power grid and the public dataset on the Internet, combining with the image augmentation method based on GraphCut. The insulator images were preprocessed by Laplace sharpening method. To solve the problems of too many parameters and low detection speed of the YOLOv4 object detection model, the MobileNet lightweight convolutional neural network was used to improve YOLOv4 model structure. Combining with the transfer learning method, the insulator image samples were used to train, verify, and test the improved YOLOV4 model. The detection results of transmission line insulator and defect images show that the detection accuracy and speed of the proposed model can reach 93.81% and 53 frames per second (FPS), respectively, and the detection accuracy can be further improved to 97.26% after image preprocessing. The overall performance of the proposed lightweight YOLOv4 model is better than traditional object detection algorithms. This study provides a reference for intelligent inspection and defect detection of suspension insulators on transmission lines.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Power Line Inspection Robots · Image Enhancement Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Energy and Electrical Engineering, School of Information Engineering, Nanchang University, Nanchang 330031, China

Funding

People's Government of Jiangxi Province, China

References (41)

Show source-provided references
1. Acoustic fault detection technique for high-power insulators10.1109/TIE.2017.2716862 ↗
2. Insulator self-shattering detection: A deep convolutional neural network approach10.1007/s11042-018-6610-4 ↗
3. A review on state-of-the-art power line inspection techniques10.1109/TIM.2020.3031194 ↗
4. A survey of mobile robots for distribution power line inspection10.1109/TPWRD.2009.2035427 ↗
5. Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning10.1016/j.ijepes.2017.12.016 ↗
6. Remote sensing methods for power line corridor surveys10.1016/j.isprsjprs.2016.04.011 ↗
7. Icing-EdgeNet: A pruning lightweight edge intelligent method of discriminative driving channel for ice thickness of transmission lines10.1109/TIM.2020.3044719 ↗
8. Li, J., Yan, D., Luan, K., Li, Z., and Liang, H. (2020). Deep learning-based bird’s nest detection on transmission lines using UAV imagery. Appl. Sci., 10.10.3390/app10186147 ↗
9. Detection method based on automatic visual shape clustering for pin-missing defect in transmission lines10.1109/TIM.2020.2969057 ↗
10. RCNN-based foreign object detection for securing power transmission lines (RCNN4SPTL)10.1016/j.procs.2019.01.232 ↗
11. Intelligent damage classification and estimation in power distribution poles using unmanned aerial vehicles and convolutional neural networks10.1109/TSG.2020.2970156 ↗
12. Intelligent diagnosis of incipient fault in power distribution lines based on corona detection in UV-visible videos10.1109/TPWRD.2020.3046161 ↗
13. Intelligent detection of vegetation encroachment of power lines with advanced stereovision10.1109/TPWRD.2020.3043433 ↗
14. Detection of power line insulator defects using aerial images analyzed with convolutional neural networks10.1109/TSMC.2018.2871750 ↗
15. An accurate and real-time method of self-blast glass insulator location based on faster R-CNN and U-net with aerial images
16. Box-Point Detector: A diagnosis method for insulator faults in power lines using aerial images and convolutional neural networks10.1109/TPWRD.2020.3048935 ↗
17. IN-YOLO: Real-time detection of outdoor high voltage insulators using UAV imaging10.1109/TPWRD.2019.2944741 ↗
18. Automatic fault diagnosis of infrared insulator images based on image instance segmentation and temperature analysis10.1109/TIM.2020.2965635 ↗
19. Han, J., Yang, Z., Zhang, Q., Chen, C., Li, H., Lai, S., Hu, G., Xu, C., Xu, H., and Wang, D. (2019). A method of insulator faults detection in aerial images for high-voltage transmission lines inspection. Appli. Sci., 9.10.3390/app9102009 ↗
20. Wen, Q., Luo, Z., Chen, R., Yang, Y., and Li, G. (2021). Deep learning approaches on defect detection in high resolution aerial images of insulators. Sensors, 21.10.3390/s21041033 ↗
21. Liu, X., Li, Y., Shuang, F., Gao, F., Zhou, X., and Chen, X. (2020). ISSD: Improved SSD for insulator and spacer online detection based on UAV system. Sensors, 20.10.3390/s20236961 ↗
22. Yu, J., and Zhang, W. (2021). Face mask wearing detection algorithm based on improved YOLO-v4. Sensors, 21.10.3390/s21093263 ↗
23. Roy, A.M., Bose, R., and Bhaduri, J. (2021). A fast accurate fine-grain object detection model based on YOLOv4 deep neural network. arXiv.10.1007/s00521-021-06651-x ↗
24. Zha, M., Qian, W., Yi, W., and Hua, J. (2021). A lightweight YOLOv4-Based forestry pest detection method using coordinate attention and feature fusion. Entropy, 23.10.3390/e23121587 ↗
25. Yang, Q., Zhang, Z., Yan, L., Wang, W., Zhang, Y., and Zhang, C. (2021, January 2–4). Lightweight bird’s nest location recognition method based on YOLOv4-tiny. Proceedings of the 2021 IEEE International Conference on Electrical Engineering and Mechatronics Technology (ICEEMT), Qingdao, China.10.1109/ICEEMT52412.2021.9602262 ↗
26. Qiu, Z., Zhu, X., Liao, C., Shi, D., Kuang, Y., Li, Y., and Zhang, Y. (2021). Detection of bird species related to transmission line faults based on lightweight convolutional neural network. IET Gener. Transm. Distrib.10.1049/gtd2.12333 ↗
27. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
28. ImageNet classification with deep convolutional neural networks
29. Lin, M., Chen, Q., and Yan, S. (2013). Network in Network. arXiv.
30. Zhang, X., Zhou, X., Lin, M., and Sun, J. (2017). ShuffleNet: An extremely efficient convolutional neural network for mobile devices. arXiv.10.1109/CVPR.2018.00716 ↗
31. Boykov, Y.Y., and Jolly, M. (2001, January 7–14). Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. Proceedings of the 8th International Conference on Computer Vision (ICCV), Vancouver, BC, Canada.
32. An enhanced scheme for interactive image segmentation
33. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision10.1109/TPAMI.2004.60 ↗
34. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
35. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv.
36. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
37. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–23). Path aggregation network for instance segmentation. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
38. Neubeck, A., and Van Gool, L. (2006, January 20–24). Efficient non-maximum suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR), Hong Kong, China.10.1109/ICPR.2006.479 ↗
39. Wang, C.Y., Liao, H.Y.M., Wu, Y.H., Chen, P.-Y., Hsieh, J.W., and Yeh, I.H. (2020, January 14–19). CSPNet: A new backbone that can enhance learning capability of CNN. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.10.1109/CVPRW50498.2020.00203 ↗
40. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
41. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Li, F.F. (2009, January 20–25). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗