journal article·2023-08-10Open access

Segmentation Head Networks with Harnessing Self-Attention and Transformer for Insulator Surface Defect Detection

Jun Guo, Tiancheng Li, Baigang Du

Applied Sciences· Volume 13· Issue 16

Abstract

Current methodologies for insulator defect detection are hindered by limitations in real-world applicability, spatial constraints, high computational demand, and segmentation challenges. Addressing these shortcomings, this paper presents a robust fast detection algorithm combined segmentation head networks with harnessing self-attention and transformer (HST-Net), which is based on the You Only Look Once (YOLO) v5 to recognize and assess the extent and types of damage on the insulator surface. Firstly, the original backbone network is replaced by the transformer cross-stage partial (Transformer-CSP) networks to enrich the network’s ability by capturing information across different depths of network feature maps. Secondly, an insulator defect segmentation head network is presented to handle the segmentation of defect areas such as insulator losses and flashovers. It facilitates instance-level mask prediction for each insulator object, significantly reducing the influence of intricate backgrounds. Finally, comparative experiment results show that the positioning accuracy and defect segmentation accuracy of the proposed both surpass that of other popular models. It can be concluded that the proposed model not only satisfies the requirements for balance between accuracy and speed in power facility inspection, but also provides fresh perspectives for research in other defect detection domains.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Image Enhancement Techniques · Infrastructure Maintenance and Monitoring

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China

Hubei Digital Manufacturing Key Laboratory, Wuhan 430070, China

References (41)

Show source-provided references
1. Zhang, M., and Li, Q. (2022, January 19–21). Research on Insulator Detection Algorithm of YOLOv5 Fused with Attention Mechanism. Proceedings of the 2022 International Conference on Artificial Intelligence, Information Processing and Cloud Computing (AIIPCC), Kunming, China.10.1109/AIIPCC57291.2022.00087 ↗
2. Zhang, X., Zhang, Y., Hu, M., and Ju, X. (November, January 30). Insulator Defect Detection Based on YOLO and SPP-Net. Proceedings of the 2020 International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE), Bangkok, Thailand.10.1109/ICBASE51474.2020.00092 ↗
3. Image Recognition Algorithm Based on Artificial Intelligence10.1007/s00521-021-06058-8 ↗
4. Lie, T.T., and Liu, Y. (2020, January 4–7). Electric Fields Distribution of 500 kV AC Transmission Line V-Type Composite Insulator with Conductive Defect. Proceedings of the 2020 5th Asia Conference on Power and Electrical Engineering (ACPEE 2020), Chengdu, China.
5. Detection of Internal Defects of Full-Size Composite Insulators Based on Microwave Technique10.1109/TIM.2021.3085111 ↗
6. Jiang, H., Mei, H., Zou, X., Li, L., and Wang, L. (2020, January 13–17). Microwave Detection Technology for Internal Defects of Composite Post Insulators. Proceedings of the 2020 International Symposium on Electrical Insulating Materials (ISEIM), Tokyo, Japan.
7. Representation of Binary Feature Pooling for Detection of Insulator Strings in Infrared Images10.1109/TDEI.2016.7736846 ↗
8. An Optimized Infrared Detection Strategy for Defective Composite Insulators According to the Law of Heat Flux Propagation Considering the Environmental Factors10.1109/ACCESS.2018.2854221 ↗
9. Wang, R., Zhang, Z., Yang, C., Nie, Z., Wang, L., Peng, X., Huang, Z., and Yang, D. (2018, January 21–24). Study on Detection of Insulator Defects in Time Domain Terahertz Wave. Proceedings of the 2018 IEEE Conference on Electrical Insulation and Dielectric Phenomena (IEEE CEIDP), Cancun, Mexico.10.1109/CEIDP.2018.8544879 ↗
10. Terahertz Imaging Method for Composite Insulator Defects Based on Edge Detection Algorithm10.1109/TIM.2021.3075031 ↗
11. An Ultrasonic Nondestructive Testing Method for Density Uniformity of Basin-Type Insulators in GIS10.1109/TIM.2021.3126847 ↗
12. Condition Monitoring of 11 KV Distribution System Insulators Incorporating Complex Imagery Using Combined DOST-SVM Approach10.1109/TDEI.2013.6508770 ↗
13. Localization of Multiple Insulators by Orientation Angle Detection and Binary Shape Prior Knowledge10.1109/TDEI.2015.004741 ↗
14. Catenary Insulator Defect Detection Based on Contour Features and Gray Similarity Matching10.1631/jzus.A1900341 ↗
15. Insulator Fault Detection Based on Spatial Morphological Features of Aerial Images10.1109/ACCESS.2018.2846293 ↗
16. Novel Feature Fusion Module-Based Detector for Small Insulator Defect Detection10.1109/JSEN.2021.3073422 ↗
17. Adversarial Reconstruction Based on Tighter Oriented Localization for Catenary Insulator Defect Detection in High-Speed Railways10.1109/TITS.2020.3020287 ↗
18. Zhang, Z., Huang, S., Li, Y., Li, H., and Hao, H. (2022). Image Detection of Insulator Defects Based on Morphological Processing and Deep Learning. Energies, 15.10.3390/en15072465 ↗
19. Chen, W., Li, Y., and Zhao, Z. (2022). Missing-Sheds Granularity Estimation of Glass Insulators Using Deep Neural Networks Based on Optical Imaging. Sensors, 22.10.3390/s22051737 ↗
20. Detection of Insulator Defects With Improved ResNeSt and Region Proposal Network10.1109/ACCESS.2020.3029857 ↗
21. Qiu, Z., Zhu, X., Liao, C., Shi, D., and Qu, W. (2022). Detection of Transmission Line Insulator Defects Based on an Improved Lightweight YOLOv4 Model. Appl. Sci., 12.10.3390/app12031207 ↗
22. Research on Insulator Defect Detection Based on an Improved MobilenetV1-YOLOv410.3390/e24111588 ↗
23. FINet: An Insulator Dataset and Detection Benchmark Based on Synthetic Fog and Improved YOLOv510.1109/TIM.2022.3194909 ↗
24. Han, G., Li, T., Li, Q., Zhao, F., Zhang, M., Wang, R., Yuan, Q., Liu, K., and Qin, L. (2022). Improved Algorithm for Insulator and Its Defect Detection Based on YOLOX. Sensors, 22.10.3390/s22166186 ↗
25. Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks. IEEE Trans10.1109/TSMC.2018.2871750 ↗
26. Insulator Breakage Detection Utilizing a Convolutional Neural Network Ensemble Implemented With Small Sample Data Augmentation and Transfer Learning10.1109/TPWRD.2021.3116600 ↗
27. Novel Motor Fault Detection Scheme Based on One-Class Tensor Hyperdisk10.1016/j.knosys.2023.110259 ↗
28. Physics-Informed Gated Recurrent Graph Attention Unit Network for Anomaly Detection in Industrial Cyber-Physical Systems10.1016/j.ins.2023.01.136 ↗
29. Mask R-CNN and Multifeature Clustering Model for Catenary Insulator Recognition and Defect Detection10.1631/jzus.A2100494 ↗
30. An Outdoor Support Insulator Surface Defects Segmentation Approach via Image Adversarial Reconstruction in High-Speed Railway Traction Substation10.1109/TIM.2022.3211558 ↗
31. Insulator Defect Recognition Based on Global Detection and Local Segmentation10.1109/ACCESS.2020.2982288 ↗
32. A Deep Learning Approach for Insulator Instance Segmentation and Defect Detection10.1007/s00521-021-06792-z ↗
33. Liu, L., Ke, C., and Lin, H. (2023). Dark-Center Based Insulator Detection Method in Foggy Environment. Appl. Sci., 13.10.3390/app13127264 ↗
34. Li, Z., Rao, Z., Ding, L., Ding, B., Fang, J., and Ma, X. (2023). YOLOv5s-D: A Railway Catenary Dropper State Identification and Small Defect Detection Model. Appl. Sci., 13.10.3390/app13137881 ↗
35. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021). An Image Is Worth 16 × 16 Words: Transformers for Image Recognition at Scale. arXiv.
36. Jin, G., Oh, S., Lee, Y., and Shin, S. (2021). Extracting Weld Bead Shapes from Radiographic Testing Images with U-Net. Appl. Sci., 11.10.3390/app112412051 ↗
37. Huang, S., Han, W., Chen, H., Li, G., and Tang, J. (2021). Recognizing Zucchinis Intercropped with Sunflowers in UAV Visible Images Using an Improved Method Based on OCRNet. Remote Sens., 13.10.3390/rs13142706 ↗
38. Zhou, Y., Wen, S., Wang, D., Mu, J., and Irampaye, R. (2021). Object Detection in Autonomous Driving Scenarios Based on an Improved Faster-RCNN. Appl. Sci., 11.10.3390/app112411630 ↗
39. Solder Joint Defect Inspection Method Based on ConvNeXt-YOLOX10.1109/TCPMT.2022.3224997 ↗
40. Wei, H., Zhang, Q., Li, X., Qin, Y., and Qian, Y. (2023). The Visual Computer, Springer.
41. An Automatic Traffic Density Estimation Using Single Shot Detection (SSD) and MobileNet-SSD10.1016/j.pce.2018.12.001 ↗