journal article·2019-05-16Open access

A Method of Insulator Faults Detection in Aerial Images for High-Voltage Transmission Lines Inspection

Jiaming Han, Zhong Yang, Qiuyan Zhang, Cong Chen, Hongchen Li, Shangxiang Lai, Guoxiong Hu, Changliang Xu, Hao Xu, Di Wang, Rui Chen

Applied Sciences· Volume 9· Issue 10

Abstract

Insulator faults detection is an important task for high-voltage transmission line inspection. However, current methods often suffer from the lack of accuracy and robustness. Moreover, these methods can only detect one fault in the insulator string, but cannot detect a multi-fault. In this paper, a novel method is proposed for insulator one fault and multi-fault detection in UAV-based aerial images, the backgrounds of which usually contain much complex interference. The shapes of the insulators also vary obviously due to the changes in filming angle and distance. To reduce the impact of complex interference on insulator faults detection, we make full use of the deep neural network to distinguish between insulators and background interference. First of all, plenty of insulator aerial images with manually labelled ground-truth are collected to construct a standard insulator detection dataset ‘InST_detection’. Secondly, a new convolutional network is proposed to obtain accurate insulator string positions in the aerial image. Finally, a novel fault detection method is proposed that can detect both insulator one fault and multi-fault in aerial images. Experimental results on a large number of aerial images show that our proposed method is more effective and efficient than the state-of-the-art insulator fault detection methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Power Line Inspection Robots · Image Enhancement Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211100, China

Key Laboratory of Navigation, Control and Health-Management Technologies of Advanced Aerocraft (Nanjing University of Aeronautics and Astronautics), Ministry of Industry and Information Technology, Nanjing 211100, China

Guizhou Power Grid Co., Ltd. Institute of Electric Power Science, Guiyang 550002 China

Department of Automation, North China Electric Power University, Baoding 071003, China

Funding

Science and Technology Projects of China Southern Power Grid Co. Ltd. · National Science Foundation of China · Aeronautical Science Foundation of China (Key Laboratory) · National Key R&D Plan

References (59)

Show source-provided references
1. Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning10.1016/j.ijepes.2017.12.016 ↗
2. Automatic identification and location technology of glass insulator self-shattering10.1117/1.JEI.26.6.063014 ↗
3. Detection of the power lines in UAV remote sensed images using spectral-spatial methods10.1016/j.jenvman.2017.09.036 ↗
4. Zhang, Y., Yuan, X., Li, W., and Chen, S. (2017). Automatic power line inspection using uav images. Remote Sens., 9.10.3390/rs9080824 ↗
5. A monocular vision–based perception approach for unmanned aerial vehicle close proximity transmission tower inspection10.1177/1729881418820227 ↗
6. Real-time transmission tower detection from video based on a feature descriptor
7. Acoustic Fault Detection Technique for High-Power Insulators10.1109/TIE.2017.2716862 ↗
8. Aggregating deep convolutional feature maps for insulator detection in infrared images10.1109/ACCESS.2017.2757030 ↗
9. A Contactless Insulator Contamination Levels Detecting Method Based on Infrared Images features and RBFNN10.1109/TIA.2018.2889835 ↗
10. A Deep Learning Approach for Oriented Electrical Equipment Detection in Thermal Images10.1109/ACCESS.2018.2859048 ↗
11. Insulator fault detection based on spatial morphological features of aerial images10.1109/ACCESS.2018.2846293 ↗
12. Li, X., Jin, L., Xu, Z., Jiang, T., and Jin, H. (2017, January 14–17). Surface discharge detection method of contaminated insulators based on ultraviolet images’ parameters. Proceedings of the 2017 1st International Conference on Electrical Materials and Power Equipment (ICEMPE), Xi’an, China.10.1109/ICEMPE.2017.7982054 ↗
13. Review on Machine Vision based Insulator Inspection Systems for Power Distribution System10.25103/jestr.095.21 ↗
14. Vision based detection and location for cracked insulator
15. Localization of multiple insulators by orientation angle detection and binary shape prior knowledge10.1109/TDEI.2015.004741 ↗
16. Detection algorithm of cracked insulator based on statistical shape models
17. Recognition and fault diagnosis of insulator string in aerial images
18. Edge Detection of High-Voltage Porcelain Insulators in Infrared Image Using Dual Parity Morphological Gradients10.1109/ACCESS.2019.2900658 ↗
19. Study on power transmission lines inspection using unmanned aerial vehicle and image recognition of insulator defect
20. Fault detection of insulator based on saliency and adaptive morphology10.1007/s11042-016-3981-2 ↗
21. Liao, S. (2017). Research on Key Techniques of Components Detection Algorithm in Power Line Images. [Ph.D. Thesis, Dalian Maritime University].
22. Tomaszewski, M., Osuchowski, J., and Debita, Ł. (2018, January 13–14). Effect of Spatial Filtering on Object Detection with the SUF Algorithm. Proceedings of the International Scientific Conference BCI 2018 Opole, Opole, Poland.10.1007/978-3-319-75025-5_12 ↗
23. Yao, X., Pan, Y., Liu, L., and Cheng, X. (2018, January 28–29). Identification and location of catenary insulator in complex background based on machine vision. Proceedings of the AIP Conference Proceedings, Coimbatore, India.10.1063/1.5033813 ↗
24. The recognition and localization of insulators adopting SURF and IFS based on correlation coefficient10.1016/j.ijleo.2014.06.094 ↗
25. A robust insulator detection algorithm based on local features and spatial orders for aerial images10.1109/LGRS.2014.2369525 ↗
26. Iruansi, U. (2017). Power-Line Insulator Defect Detection and Classification, University of KwaZulu-Natal.
27. The identification and diagnosis of self-blast defects of glass insulators based on multi-feature fusion
28. Contour extraction and fault detection of insulator strings in aerial images
29. Cheng, H., Zhai, Y., Chen, R., Wang, D., Dong, Z., and Wang, Y. (2019). Self-Shattering Defect Detection of Glass Insulators Based on Spatial Features. Energies, 12.10.3390/en12030543 ↗
30. An active contour model based on texture distribution for extracting inhomogeneous insulators from aerial images10.1109/TGRS.2013.2274101 ↗
31. Image Segmentation Method of Insulator in Transmission Line Based on Weighted Variable Fuzzy C-Means10.25103/jestr.104.16 ↗
32. Guo, L., Liao, Y., Yao, H., Chen, J., and Wang, M. (2018). An Electrical Insulator Defects Detection Method Combined Human Receptive Field Model. J. Control Sci. Eng., 2018.10.1155/2018/2371825 ↗
33. Zhai, Y., Wang, D., Guo, Y., Zhang, M., and Liu, Y. (2016). Recognition of Aerial Insulator Image Based on Structural Model and the Optimal Entropy Threshold Segmentation. DEStech Trans. Eng. Technol. Res.10.12783/dtetr/iceta2016/7036 ↗
34. Location and detection for self-explode insulator based on vision
35. Cui, K. (2016). Research on the Key Technologies in Insulator Defect Detection Based on Image. [Ph.D. Thesis, North China Electric Power University].
36. Tiantian, Y., Guodong, Y., and Junzhi, Y. (2017, January 26–28). Feature fusion based insulator detection for aerial inspection. Proceedings of the 2017 36th Chinese Control Conference (CCC), Dalian, China.10.23919/ChiCC.2017.8029108 ↗
37. Zuo, D., Hu, H., Qian, R., and Liu, Z. (2017, January 18–20). An insulator defect detection algorithm based on computer vision. Proceedings of the 2017 IEEE International Conference on Information and Automation (ICIA), Macau, China.10.1109/ICInfA.2017.8078934 ↗
38. Oberweger, M., Wendel, A., and Bischof, H. (2014, January 3–5). Visual recognition and fault detection for power line insulators. Proceedings of the 19th Computer Vision Winter Workshop, Křtiny, Czech Republic.
39. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 26–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Dalian, China.10.1109/CVPR.2014.81 ↗
40. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
41. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
42. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
43. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
44. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
45. Advanced deep-learning techniques for salient and category-specific object detection: A survey10.1109/MSP.2017.2749125 ↗
46. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Li, F.-F. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
47. Xiang, X., Lv, N., Guo, X., Wang, S., and El Saddik, A. (2018). Engineering Vehicles Detection Based on Modified Faster R-CNN for Power Grid Surveillance. Sensors, 18.10.3390/s18072258 ↗
48. Ma, L., Xu, C., Zuo, G., Bo, B., and Tao, F. (August, January 31). Detection Method of Insulator Based on Faster R-CNN. Proceedings of the 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Honolulu, HI, USA.10.1109/CYBER.2017.8446155 ↗
49. Kang, G., Gao, S., Yu, L., and Zhang, D. (2018). Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning. IEEE Trans. Instrum. Meas.10.1109/TIM.2018.2868490 ↗
50. Ling, Z., Qiu, R.C., Jin, Z., Zhang, Y., He, X., Liu, H., and Chu, L. (2018). An Accurate and Real-time Self-blast Glass Insulator Location Method Based On Faster R-CNN and U-net with Aerial Images. arXiv.
51. Tao, X., Zhang, D., Wang, Z., Liu, X., Zhang, H., and Xu, D. (2018). Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks. IEEE Trans. Syst. Man Cybern. Syst., 1–13.
52. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA.
53. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
54. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
55. (2018, September 10). Available online: https://github.com/AlexeyAB/darknet.
56. Lin, M., Chen, Q., and Yan, S. (2013). Network in network. arXiv.
57. Grabcut: Interactive foreground extraction using iterated graph cuts. ACM transactions on graphics (TOG)
58. (2018, October 15). Available online: https://github.com/tzutalin/labelImg.
59. (2018, September 12). Available online: https://www.photoshopessentials.com.