journal article·2025Open access

A Mask-Guided Latent Low-Rank Representation Method for Infrared and Visible Image Fusion

Kezhen Xie, Syed Mohd Zahid Syed Zainal Ariffin, Muhammad Izzad Ramli

Computers, Materials & Continua· Volume 84· Issue 1

Abstract

Infrared and visible image fusion technology integrates the thermal radiation information of infrared images with the texture details of visible images to generate more informative fused images. However, existing methods often fail to distinguish salient objects from background regions, leading to detail suppression in salient regions due to global fusion strategies. This study presents a mask-guided latent low-rank representation fusion method to address this issue. First, the GrabCut algorithm is employed to extract a saliency mask, distinguishing salient regions from background regions. Then, latent low-rank representation (LatLRR) is applied to extract deep image features, enhancing key information extraction. In the fusion stage, a weighted fusion strategy strengthens infrared thermal information and visible texture details in salient regions, while an average fusion strategy improves background smoothness and stability. Experimental results on the TNO dataset demonstrate that the proposed method achieves superior performance in SPI, MI, Qabf, PSNR, and EN metrics, effectively preserving salient target details while maintaining balanced background information. Compared to state-of-the-art fusion methods, our approach achieves more stable and visually consistent fusion results. The fusion code is available on GitHub at: (accessed on 15 January 2025).
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Image Fusion Techniques · Remote-Sensing Image Classification · Infrared Target Detection Methodologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (34)

Show source-provided references
1. Image fusion meets deep learning: a survey and perspective10.1016/j.inffus.2021.06.008 ↗
2. MCnet: multiscale visible image and infrared image fusion network10.1016/j.sigpro.2023.108996 ↗
3. AFusion: multiscale attention network for infrared and visible image fusion
4. Infrared and visible images fusion by using sparse representation and guided filter10.1080/15472450.2019.1643725 ↗
5. Infrared and visible image fusion method based on sparse features10.1016/j.infrared.2018.06.029 ↗
6. Image fusion via feature residual and statistical matching10.1049/iet-cvi.2015.0280 ↗
7. Joint principal component analysis and total variation for infrared and visible image fusion10.1016/j.infrared.2022.104523 ↗
8. Infrared and visible image fusion algorithm based on spatial domain and image features10.1371/journal.pone.0278055 ↗
9. Infrared and visible image fusion based on variational auto-encoder and infrared feature compensation10.1016/j.infrared.2021.103839 ↗
10. Infrared and visible image fusion based on adversarial feature extraction and stable image reconstruction
11. Infrared-visible image fusion based on convolutional neural networks (CNN)
12. NFusion: a unified multi-scale densely connected network for infrared and visible image fusion10.1109/TCSVT.2021.3109895 ↗
13. Coupled GAN with relativistic discriminators for infrared and visible images fusion10.1109/JSEN.2019.2921803 ↗
14. AT-GAN: a generative adversarial network with attention and transition for infrared and visible image fusion10.1016/j.inffus.2022.12.007 ↗
15. Segmentation method for medical image based on improved GrabCut10.1002/ima.22242 ↗
16. Li H, Wu X. Infrared and visible image fusion using latent low-rank representation. arXiv:1804.08992. 2018.10.1109/ICPR.2018.8546006 ↗
17. Bayesian’s probabilistic strategy for feature fusion from visible and infrared images10.1007/s00371-023-03078-4 ↗
18. Infrared and visible image fusion using quantum computing induced edge preserving filter10.1016/j.imavis.2024.105344 ↗
19. DenseFuse: a fusion approach to infrared and visible images10.1109/TIP.2018.2887342 ↗
20. FusionGAN: a generative adversarial network for infrared and visible image fusion10.1016/j.inffus.2018.09.004 ↗
21. Rethinking the image fusion: a fast unified image fusion network based on proportional maintenance of gradient and intensity10.1609/aaai.v34i07.6975 ↗
22. RFN-Nest: an end-to-end residual fusion network for infrared and visible images10.1016/j.inffus.2021.02.023 ↗
23. Laplacian pyramid fusion network with hierarchical guidance for infrared and visible image fusion10.1109/TCSVT.2023.3245607 ↗
24. CrossFuse: a novel cross attention mechanism based infrared and visible image fusion approach10.1016/j.inffus.2023.102147 ↗
25. Infrared-visible image fusion using dual-branch auto-encoder with invertible high-frequency encoding10.1109/TCSVT.2024.3493254 ↗
26. Color-aware fusion of nighttime infrared and visible images10.1016/j.engappai.2024.109521 ↗
27. Review of GrabCut in image processing10.3390/math11081965 ↗
28. Nie F, Pei S, Zheng Z, Wang R, Li X. A greedy strategy for graph cut. arXiv:2412.20035. 2024.
29. Latent low-rank representation10.1007/978-3-319-12000-3_2 ↗
30. The TNO multiband image data collection10.1016/j.dib.2017.09.038 ↗
31. SeGFusion: a semantic saliency guided infrared and visible image fusion method10.1016/j.infrared.2024.105344 ↗
32. Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain10.1007/s40747-022-00792-9 ↗
33. Review of various image fusion algorithms and image fusion performance metric10.1007/s11831-020-09518-x ↗
34. Assessment of image fusion procedures using entropy, image quality, and multispectral classification10.1117/1.2945910 ↗