journal article·2026-02-28Open access

SAMCM-SR: Applying SAM3 Under Data-Scarce Conditions for Cross-Modal Segmentation of Power Equipment Infrared Images with Super-Resolution Enhancement

Junchao Wang, Xiang Wu, Tianrui Yang, Yin Wang, Mengru Xiao, Gaoxing Zheng

Applied Sciences· Volume 16· Issue 5

Abstract

Infrared thermography is a significant and extensively utilized method for assessing the operational condition of power equipment. Nonetheless, the constrained spatial resolution of infrared imaging systems, imaging noise, and the inadequate representational capacity of single-modality data render the precise segmentation of power equipment targets difficult, particularly in intricate backdrops and settings with weak structures. Simultaneously, obtaining high-quality pixel-level annotations for power equipment is expensive and laborious, leading to a scarcity of training samples and thus diminishing the efficacy of conventional supervised segmentation techniques. This research offers a super-resolution guided cross-modal segmentation strategy to tackle these issues in data-scarce circumstances and examines the applicability of the general-purpose segmentation model Segment Anything Model 3 (SAM3) for infrared image segmentation of power equipment. A super-resolution reconstruction framework based on a high-order degradation model is built to enhance low-resolution infrared images collected in real-world contexts. An Enhanced Super-Resolution Generative Adversarial Networks (ESRGAN) -based network incorporating residual-in-residual dense blocks (RRDB) is utilized to reconstruct infrared thermograms, hence improving structural features and boundary representations. Secondly, the concurrently obtained visible-light images are improved by low-light enhancement methods, and an anchor-free object detection framework is employed to ensure accurate localization of power equipment targets. The identified areas in visible images are aligned with the coordinate system of infrared super-resolution images via cross-modal geometric transformation, establishing a cross-modal spatial prior that efficiently limits the search space for infrared segmentation and mitigates background interference. The general-purpose segmentation model SAM3 is introduced, utilizing cross-modal detection boxes as prompts to facilitate precise segmentation of power equipment targets in infrared super-resolution images, achieving high-accuracy segmentation without the necessity for extensive task-specific annotated data. The experimental results demonstrate that our proposed approach significantly improves both the accuracy and robustness of infrared image segmentation for power equipment under complex conditions, attaining a Jaccard index of 89.86% and a Dice coefficient of 91.12%, thereby validating its efficacy and practical applicability in data-scarce environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Thermography and Photoacoustic Techniques · Solar Radiation and Photovoltaics · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China

Key Laboratory of Grain Information Processing and Control, Henan University of Technology, Zhengzhou 450001, China

Henan Key Laboratory of Grain Storatory of Grain Information Intelligent Perception and Decision Making, Zhengzhou 450001, China

Funding

The National Natural Science Foundation of China · Open Project of Key Laboratory of Grain Information Processing and Control · Undergraduate Innovation Training Program Project of HAUT

References (38)

Show source-provided references
1. Research on the Temperature Rise Characteristics of Induction Motors with Stator Inter-Turn Fault
2. Application of Infrared Thermal Imaging Technology to Condition-Based Maintenance of Power Equipment
3. Research Progress of Power Equipment Identification and Thermal Fault Diagnosis Based on Infrared Images
4. Segmentation of Electric Equipment Infrared Image Based on CA and OTSU
5. Li, W., Miao, Z., Mu, J., and Li, F. (2022). Infrared Image Superpixel Segmentation Based on Seed Strategy of Contour Encoding. Appl. Sci., 12.10.3390/app12020602 ↗
6. Infrared Image-Based Fault Diagnosis of Asynchronous Motor Based on Cross-Paradigm Feature Fusion and Few-Shot Learning
7. Style Transformation Super-Resolution GAN for Extremely Small Infrared Target Image10.1016/j.patrec.2023.08.013 ↗
8. IRSRMamba: Infrared Image Super-Resolution via Mamba-Based Wavelet Transform Feature Modulation Model10.1109/TGRS.2025.3584385 ↗
9. LKFormer: Large Kernel Transformer for Infrared Image Super-Resolution10.1007/s11042-024-18409-3 ↗
10. An Intelligent Multi-Sensor Information Fusion Fault Diagnosis Method of Three-Phase Motors Based on Game Mapping Learning
11. MSIS: Multispectral Instance Segmentation Method for Power Equipment
12. Deep Learning-Based Infrared and Visible Image Fusion: A Survey
13. Learning a Deep Convolutional Network for Image Super-Resolution10.1109/TPAMI.2015.2439281 ↗
14. Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27–30). Accurate Image Super-Resolution Using Very Deep Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.182 ↗
15. Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 21–26). Enhanced Deep Residual Networks for Single Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.151 ↗
16. Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., and Fu, Y. (2018, January 8–14). Image Super-Resolution Using Very Deep Residual Channel Attention Networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_18 ↗
17. Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., and Timofte, R. (2021, January 11–17). SwinIR: Image Restoration Using Swin Transformer. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.10.1109/ICCVW54120.2021.00210 ↗
18. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Springer.10.1007/978-3-319-24574-4_28 ↗
19. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
20. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
21. Wang, X., Xie, L., Dong, C., and Shan, Y. (2021, January 11–17). Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00217 ↗
22. Wu, W., Weng, J., Zhang, P., Wang, X., Yang, W., and Jiang, J. (2022, January 18–24). URetinex-Net: Retinex-Based Deep Unfolding Network for Low-Light Image Enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00581 ↗
23. Improved YOLOv8-Based Method for Drill Rod Counting in Low-Light Underground Coal Mine Images
24. A Flexible New Technique for Camera Calibration10.1109/34.888718 ↗
25. A Contour Angle Orientation for Power Equipment Infrared and Visible Image Registration10.1109/TPWRD.2020.3011962 ↗
26. Li, J., Feng, Y., Guo, Y., Huang, J., Piao, Y., Bi, Q., Zhang, M., Zhao, X., Chen, Q., and Zou, S. (2025). SAM3-I: Segment Anything with Instructions. arXiv.
27. The Distribution of the Flora in the Alpine Zone10.1111/j.1469-8137.1912.tb05611.x ↗
28. Measures of the Amount of Ecologic Association Between Species10.2307/1932409 ↗
29. Ma, C., Rao, Y., Cheng, Y., Chen, C., Lu, J., and Zhou, J. (2020, January 13–19). Structure-Preserving Super Resolution with Gradient Guidance. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00779 ↗
30. Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Loy, C.C., Qiao, Y., and Tang, X. (2018, January 8–14). ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. Proceedings of the European Conference on Computer Vision Workshops, Munich, Germany.10.1007/978-3-030-11021-5_5 ↗
31. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision, Springer.10.1007/978-3-319-46448-0_2 ↗
32. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
33. Wang, J., Yang, P., Liu, Y., Shang, D., Hui, X., Song, J., and Chen, X. (2023). Research on Improved YOLOv5 for Low-Light Environment Object Detection. Electronics, 12.10.3390/electronics12143089 ↗
34. Low-Light Target Detection Algorithm Based on Multi-Level Feature Extraction
35. Li, Z., and Chen, J. (2015, January 7–12). Superpixel Segmentation Using Linear Spectral Clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.
36. A Threshold Selection Method from Gray-Level Histograms10.1109/TSMC.1979.4310076 ↗
37. SLIC Superpixels Compared to State-of-the-Art Superpixel Methods10.1109/TPAMI.2012.120 ↗
38. Interactive Image Segmentation by Maximal Similarity Based Region Merging10.1016/j.patcog.2009.03.004 ↗