journal article·2025Open access

An Infrared-Visible Image Fusion Network with Channel-Switching for Low-Light Object Detection

Tianzhe Jiao, Yuming Chen, Xiaoyue Feng, Chaopeng Guo, Jie Song

Computers, Materials & Continua· Volume 85· Issue 2

Abstract

Visible-infrared object detection leverages the day-night stable object perception capability of infrared images to enhance detection robustness in low-light environments by fusing the complementary information of visible and infrared images. However, the inherent differences in the imaging mechanisms of visible and infrared modalities make effective cross-modal fusion challenging. Furthermore, constrained by the physical characteristics of sensors and thermal diffusion effects, infrared images generally suffer from blurred object contours and missing details, making it difficult to extract object features effectively. To address these issues, we propose an infrared-visible image fusion network that realizes multimodal information fusion of infrared and visible images through a carefully designed multi-scale fusion strategy. First, we design an adaptive gray-radiance enhancement (AGRE) module to strengthen the detail representation in infrared images, improving their usability in complex lighting scenarios. Next, we introduce a channel-spatial feature interaction (CSFI) module, which achieves efficient complementarity between the RGB and infrared (IR) modalities via dynamic channel switching and a spatial attention mechanism. Finally, we propose a multi-scale enhanced cross-attention fusion (MSECA) module, which optimizes the fusion of multi-level features through dynamic convolution and gating mechanisms and captures long-range complementary relationships of cross-modal features on a global scale, thereby enhancing the expressiveness of the fused features. Experiments on the KAIST, M3FD, and FLIR datasets demonstrate that our method delivers outstanding performance in daytime and nighttime scenarios. On the KAIST dataset, the miss rate drops to 5.99%, and further to 4.26% in night scenes. On the FLIR and M3FD datasets, it achieves scores of 79.4% and 88.9%, respectively.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Image Fusion Techniques · Infrared Target Detection Methodologies · Remote-Sensing Image Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (47)

Show source-provided references
1. LRAF-Net: long-range attention fusion network for visible–infrared object detection10.1109/TNNLS.2023.3266452 ↗
2. Dual-dynamic cross-modal interaction network for multimodal remote sensing object detection
3. NOT-156: night object tracking using low-light and thermal infrared: from multimodal common-aperture camera to benchmark datasets10.1109/TGRS.2025.3628639 ↗
4. Attention enhanced machine instinctive vision with human-inspired saliency detection10.1016/j.imavis.2024.105308 ↗
5. PFCFuse: a poolformer and CNN fusion network for infrared-visible image fusion
6. Multi-party privacy-preserving faster R-CNN framework for object detection
7. DANet: a dual-branch framework with diffusion-integrated autoencoder for infrared–visible image fusion
8. Feature extraction and fusion algorithm for infrared visible light images based on residual and generative adversarial network10.1016/j.imavis.2024.105346 ↗
9. Infrared and visible light fusion for object detection with low-light enhancement
10. Improving multispectral pedestrian detection by addressing modality imbalance problems
11. MLPD: multi-label pedestrian detector in multispectral domain10.1109/LRA.2021.3099870 ↗
12. Cross-modal local calibration and global context modeling network for RGB–infrared remote-sensing object detection10.1109/JSTARS.2023.3315544 ↗
13. Fast R-CNN
14. A review of Yolo algorithm developments10.1016/j.procs.2022.01.135 ↗
15. Object detection in thermal spectrum for advanced driver-assistance systems (ADAS)10.1109/ACCESS.2021.3129150 ↗
16. Lightweight transformer-driven multi-scale trapezoidal attention network for saliency detection10.1016/j.engappai.2025.110917 ↗
17. Li C, Song D, Tong R, Tang M. Multispectral pedestrian detection via simultaneous detection and segmentation. arXiv:1808.04818. 2018.
18. Attention fusion network for multi-spectral semantic segmentation10.1016/j.patrec.2021.03.015 ↗
19. Multimodal object detection via probabilistic ensembling
20. Guided attentive feature fusion for multispectral pedestrian detection
21. Multimodal object detection by channel switching and spatial attention
22. KAIST multi-spectral day/night data set for autonomous and assisted driving10.1109/TITS.2018.2791533 ↗
23. Weakly aligned cross-modal learning for multispectral pedestrian detection
24. Target-aware dual adversarial learning and a multi-scenario multi-modality benchmark to fuse infrared and visible for object detection
25. Fast feature pyramids for object detection10.1109/TPAMI.2014.2300479 ↗
26. Illumination-aware faster R-CNN for robust multispectral pedestrian detection10.1016/j.patcog.2018.08.005 ↗
27. Liu J, Zhang S, Wang S, Metaxas DN. Multispectral deep neural networks for pedestrian detection. arXiv:1611.02644. 2016.10.5244/C.30.73 ↗
28. Cross-modality interactive attention network for multispectral pedestrian detection10.1016/j.inffus.2018.09.015 ↗
29. BAANet: learning bi-directional adaptive attention gates for multispectral pedestrian detection
30. ICAFusion: iterative cross-attention guided feature fusion for multispectral object detection10.1016/j.patcog.2023.109913 ↗
31. Attentive alignment network for multispectral pedestrian detection
32. PIAFusion: a progressive infrared and visible image fusion network based on illumination aware10.1016/j.inffus.2022.03.007 ↗
33. Rethinking the necessity of image fusion in high-level vision tasks: a practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity10.1016/j.inffus.2023.101870 ↗
34. CDDFuse: correlation-driven dual-branch feature decomposition for multi-modality image fusion
35. DATFuse: infrared and visible image fusion via dual attention transformer10.1109/TCSVT.2023.3234340 ↗
36. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
37. MMI-Det: exploring multi-modal integration for visible and infrared object detection10.1109/TCSVT.2024.3418965 ↗
38. CAMDet: condition-adaptive multispectral object detection using a visible-thermal translation model
39. Boosting visible-infrared image fusion and target detection performance with sleep-wake joint learning
40. Edge feature enhanced transformer network for RGB and infrared image fusion based object detection10.1016/j.infrared.2025.105824 ↗
41. Efficient multimodal object detection via coordinate attention fusion for adverse environmental conditions10.1016/j.dsp.2024.104873 ↗
42. FDFuse: infrared and visible image fusion based on feature decomposition10.1109/TIM.2025.3614898 ↗
43. HiFusion: an unsupervised infrared and visible image fusion framework with a hierarchical loss function
44. CM-MCNet: convolution and multilayer perceptron-integrated multiscale coordinate network for infrared and visible image fusion10.1016/j.patcog.2025.111843 ↗
45. A semantic-driven coupled network for infrared and visible image fusion10.1016/j.inffus.2024.102352 ↗
46. Multispectral target detection based on deep feature fusion of visible and infrared modalities10.3390/app15115857 ↗
47. Microsoft coco: common objects in context