Infrared Dim and Small Target Detection Based on Local–Global Feature Fusion
Source abstract
Abstract
Infrared detection, known for its robust anti-interference capabilities, performs well in all weather conditions and various environments. Its applications include precision guidance, surveillance, and early warning systems. However, detecting infrared dim and small targets presents challenges, such as weak target features, blurred targets with small area percentages, missed detections, and false alarms. To address the issue of insufficient target feature information, this paper proposes a high-precision method for detecting dim and small infrared targets based on the YOLOv7 network model, which integrates both local and non-local bidirectional features. Additionally, a local feature extraction branch is introduced to enhance target information by applying local magnification at the feature extraction layer allowing for the capture of more detailed features. To address the challenge of target and background blending, we propose a strategy involving multi-scale fusion of the local branch and global feature extraction. Additionally, the use of a 1 × 1 convolution structure and concat operation reduces model computation. Compared to the baseline, our method shows a 2.9% improvement in mAP50 on a real infrared dataset, with the detection rate reaching 93.84%. These experimental results underscore the effectiveness of our method in extracting relevant features while suppressing background interference in infrared dim and small target detection (IDSTD), making it more robust.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrared Target Detection Methodologies · Thermography and Photoacoustic Techniques · Advanced Measurement and Detection Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
Funding
National Science and Technology Foundation of China
References (39)
Show source-provided references
1. Infrared small UAV target detection based on residual image prediction via global and local dilated residual networks
2. Small infrared target detection based on weighted local difference measure10.1109/TGRS.2016.2538295 ↗
3. Infrared dim and small target detection via multiple subspace learning and spatial-temporal patch-tensor model10.1109/TGRS.2020.3022069 ↗
4. Liu, S., Chen, P., and Woźniak, M. (2022). Image Enhancement-Based Detection with Small Infrared Targets. Remote Sens., 14.10.3390/rs14133232 ↗
5. A spatial-temporal feature-based detection framework for infrared dim small target
6. Boccignone, G., Chianese, A., and Picariello, A. (1998, January 16–20). Small target detection using wavelets. Proceedings of the Fourteenth International Conference on Pattern Recognition (Cat. No. 98EX170), Brisbane, Australia.
7. Analysis of new top-hat transformation and the application for infrared dim small target detection10.1016/j.patcog.2009.12.023 ↗
8. Bilateral two-dimensional least mean square filter for infrared small target detection10.1016/j.infrared.2014.03.006 ↗
9. Lei, B., Hao, W., Yan, K., and Li, J. (2020, January 7–9). Signal denoising of multi element infrared signal based on wavelet transform. Proceedings of the 2020 International Conference on Electrical Technology and Automatic Control ICETAC, Anhui, China.
10. A small target detection algorithm in infrared image by combining multi-response fusion and local contrast enhancement10.1016/j.ijleo.2021.166919 ↗
11. Adaptive top-hat filter based on quantum genetic algorithm for infrared small target detection10.1007/s11042-017-4592-2 ↗
12. On suboptimal detection of 3-dimensional moving targets10.1109/7.30789 ↗
13. A novel spatiotemporal saliency method for low-altitude slow small infrared target detection
14. Infrared moving point target detection based on spatial-temporal local contrast filter10.1016/j.infrared.2016.02.010 ↗
15. Yang, C., Duraiswami, R., and Davis, L. (2005, January 17–21). Fast multiple object tracking via a hierarchical particle filter. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05), Beijing, China.
16. Moving dim point target detection with three-dimensional wide-to-exact search directional filtering10.1016/j.patrec.2006.07.006 ↗
17. Three-dimensional pipeline Hough transform for small target detection10.1117/1.OE.60.2.023102 ↗
18. Mo, Y., Wang, L., Hong, W., Chu, C., Li, P., and Xia, H. (2024). Small-Scale Foreign Object Debris Detection Using Deep Learning and Dual Light Modes. Appl. Sci., 14.10.3390/app14052162 ↗
19. Lu, D., Tan, J., Wang, M., Teng, L., Wang, L., and Gu, G. (2023). Infrared Ship Target Detection Based on Dual Channel Segmentation Combined with Multiple Features. Appl. Sci., 13.10.3390/app132212247 ↗
20. Braham, M., and Van Droogenbroeck, M. (2016, January 23–25). Deep background subtraction with scene-specific convolutional neural networks. Proceedings of the 2016 International Conference on Systems, Signals and Image Processing (IWSSIP), Bratislava, Slovakia.10.1109/IWSSIP.2016.7502717 ↗
21. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster R-CNN: Towards real-time object detection with region proposal networks. Proceedings of the NIPS’15: 28th International Conference on Neural Information Processing Systems, Montreal, QC, Canada.
22. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). Ssd: Single shot multibox detector. Proceedings of the Computer Vision-ECCV 2016: 14th European Conference, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
23. Real-time dense small object detection algorithm for UAV based on improved YOLOv5
24. Dim infrared image enhancement based on convolutional neural network10.1016/j.neucom.2017.07.017 ↗
25. Wang, Y., Zhao, L., Ma, Y., Shi, Y., and Tian, J. (2023). Multiscale YOLOv5-AFAM-Based Infrared Dim-Small-Target Detection. Appl. Sci., 13.10.20944/preprints202306.0281.v1 ↗
26. Struck: Structured output tracking with kernels10.1109/TPAMI.2015.2509974 ↗
27. A Study of CR-DuNN based on the LSTM and Du-CNN to Predict Infrared Target Feature and Classify Targets from the Clutters
28. Cross-layer attention network for small object detection in remote sensing imagery10.1109/JSTARS.2020.3046482 ↗
29. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
30. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2023, January 17–24). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
31. Infrared patch-image model for small target detection in a single image10.1109/TIP.2013.2281420 ↗
32. Infrared small target detection based on gray intensity descent and local gradient watershed10.1016/j.infrared.2022.104171 ↗
33. Zhang, L., Peng, L., Zhang, T., Cao, S., and Peng, Z. (2018). Infrared small target detection via non-convex rank approximation minimization joint l2,1 norm. Remote Sens., 10.10.3390/rs10111821 ↗
34. Zhang, T., Wu, H., Liu, Y., Peng, L., Yang, C., and Peng, Z. (2019). Infrared small target detection based on non-convex optimization with Lp-norm constraint. Remote Sens., 11.10.3390/rs11050559 ↗
35. Zhang, L., and Peng, Z. (2019). Infrared small target detection based on partial sum of the tensor nuclear norm. Remote Sens., 11.10.3390/rs11040382 ↗
36. A local contrast method for infrared small-target detection utilizing a tri-layer window10.1109/LGRS.2019.2954578 ↗
37. Infrared small target detection based on local intensity and gradient properties10.1016/j.infrared.2017.12.018 ↗
38. Wang, Z., Cheng, Z., Huang, H., and Zhao, J. (2019, January 22–24). ShuDA-RFBNet for Real-time multi-task traffic scene perception. Proceedings of the 2019 Chinese Automation Congress (CAC), Hangzhou, China.10.1109/CAC48633.2019.8997236 ↗
39. ISTDU-Net: Infrared Small-Target Detection U-Net