Attention Shift-Invariant Cross-Evolutionary Feature Fusion Network for Infrared Small Target Detection
Source abstract
Abstract
Infrared images typically exhibit diverse backgrounds, each potentially containing noise and target-like interference elements. In complex backgrounds, infrared small targets are prone to be submerged by background noise due to their low pixel proportion and limited available features, leading to detection failure. To address this problem, this paper proposes an Attention Shift-Invariant Cross-Evolutionary Feature Fusion Network (ASCFNet) tailored for the detection of infrared weak and small targets. The network architecture first designs a Multidimensional Lightweight Pixel-level Attention Module (MLPA), which alleviates the issue of small-target feature suppression during deep network propagation by combining channel reshaping, multi-scale parallel subnet architectures, and local cross-channel interactions. Then, a Multidimensional Shift-Invariant Recall Module (MSIR) is designed to ensure the network remains unaffected by minor input perturbations when processing infrared images, through focusing on the model’s shift invariance. Subsequently, a Cross-Evolutionary Feature Fusion structure (CEFF) is designed to allow flexible and efficient integration of multidimensional feature information from different network hierarchies, thereby achieving complementarity and enhancement among features. Experimental results on three public datasets, SIRST, NUDT-SIRST, and IRST640, demonstrate that our proposed network outperforms advanced algorithms in the field. Specifically, on the NUDT-SIRST dataset, the mAP50, mAP50-95, and metrics reached 99.26%, 85.22%, and 99.31%, respectively. Visual evaluations of detection results in diverse scenarios indicate that our algorithm exhibits an increased detection rate and reduced false alarm rate. Our method balances accuracy and real-time performance, and achieves efficient and stable detection of infrared weak and small targets.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrared Target Detection Methodologies · Infrared Thermography in Medicine · Advanced Image Fusion Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (46)
Show source-provided references
1. Infrared dim small target detection networks: a review10.3390/s24123885 ↗
2. EAAU-Net: enhanced asymmetric attention U-Net for infrared small target detection10.3390/rs13163200 ↗
3. Single-frame infrared small-target detection: a survey10.1109/MGRS.2022.3145502 ↗
4. Top-hat selection transformation for infrared dim small target enhancement10.1179/136821909X12581187860176 ↗
5. Background modeling in the fourier domain for maritime infrared target detection10.1109/TCSVT.2019.2922036 ↗
6. A multiscale fuzzy metric for detecting small infrared targets against chaotic cloudy/sea-sky backgrounds10.1109/TCYB.2018.2810832 ↗
7. Infrared small target detection based on flux density and direction diversity in gradient vector field10.1109/JSTARS.2018.2828317 ↗
8. A novel approach for interest point detection via laplacian-of-bilateral filter10.1155/2015/685154 ↗
9. A local contrast method for small infrared target detection10.1109/TGRS.2013.2242477 ↗
10. A robust infrared small target detection algorithm based on human visual system10.1109/LGRS.2014.2323236 ↗
11. Multiscale patch-based contrast measure for small infrared target detection10.1016/j.patcog.2016.04.002 ↗
12. Infrared small target detection utilizing the multiscale relative local contrast measure10.1109/LGRS.2018.2790909 ↗
13. Infrared patch-image model for small target detection in a single image10.1109/TIP.2013.2281420 ↗
14. Sabahi MF fast and robust small infrared target detection using absolute directional mean difference algorithm10.1016/j.sigpro.2020.107727 ↗
15. Asymmetric contextual modulation for infrared small target detection
16. Attentional local contrast networks for infrared small target detection10.1109/TGRS.2020.3044958 ↗
17. Dense nested attention network for infrared small target detection10.1109/TIP.2022.3199107 ↗
18. Attention-guided pyramid context networks for detecting infrared small target under complex background10.1109/TAES.2023.3238703 ↗
19. IRSTFormer: a hierarchical vision transformer for infrared small target detection10.3390/rs14143258 ↗
20. SimAM: a simple, parameter-free attention module for convolutional neural networks
21. Efficient multi-scale attention module with cross-spatial learning
22. Mixed local channel attention for object detection10.1016/j.engappai.2023.106442 ↗
23. Pan Z, Cai J, Zhuang B. Fast vision transformers with HiLo attention. arXiv:2205.13213. 2023.
24. FLatten transformer: vision transformer using focused linear attention
25. Goyal A, Bochkovskiy A, Deng J, Koltun V. Non-deep networks. arXiv:2110.07641. 2021.
26. BiFormer: vision transformer with bi-level routing attention
27. Large selective kernel network for remote sensing object detection
28. HCF-Net: hierarchical context fusion network for infrared small object detection
29. DeepLab: semantic image segmentation with deep convolutional nets, Atrous convolution, and fully connected CRFs10.1109/TPAMI.2017.2699184 ↗
30. Deformable ConvNets V2: more deformable, better results
31. Sunkara R, Luo T. No more strided convolutions or pooling: a new CNN building block for low-resolution images and small objects. arXiv:2208.03641. 2022.10.1007/978-3-031-26409-2_27 ↗
32. Zhang R. Making convolutional networks shift-invariant again. arXiv:1904.11486. 2019.
33. Li C, Zhou A, Yao A. Omni-dimensional dynamic convolution. arXiv:2209.07947. 2022.
34. Zhang X, Liu C, Yang D, Song T, Ye Y, Li K, et al. RFAConv: innovating spatial attention and standard convolutional operationar. arXiv:2304.03198. 2024.
35. AFPN: asymptotic feature pyramid network for object detection
36. Attention as activation
37. SSD: single shot MultiBox detector
38. Yolov5/Ultralytics [Internet]. [cited 2024 Dec 11]. Available from: https://github.com/ultralytics/yolov5/releases.
39. Jocher G. Ultralytics. Ultralytics YOLO [Internet]. [cited 2024 Dec 11]. Available from: https://docs.ultralytics.com/zh/models/yolov8/.
40. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, et al. An image is worth 16 × 16 words: transformers for image recognition at scale. arXiv:2010.11929. 2020.
41. Mehta S, Rastegari M. MobileViT: light-weight, general-purpose, and mobile-friendly vision transformer. arXiv:2110.02178. 2021.
42. Swin Transformer: hierarchical vision transformer using shifted Windows
43. Miss detection vs. false alarm: adversarial learning for small object segmentation in infrared images
44. Interior attention-aware network for infrared small target detection
45. Infrared small target detection based on partial sum of the tensor nuclear norm10.3390/rs11040382 ↗
46. Infrared small target detection via self-regularized weighted sparse model10.1016/j.neucom.2020.08.065 ↗