LGIFNet: an infrared and visible image fusion network with local-global frequency interaction
Source abstract
Abstract
The fusion of infrared and visible light images aims to combine the texture details of visible light and the thermal radiation information of infrared images to generate a more comprehensive fused image, providing stronger support for visual analysis and processing. However, existing methods struggle to preserve the integrity of the global structure and the clarity of details, making it difficult to process global features and detail information simultaneously, resulting in loss or blurring of fused image information. To address these challenges, this paper proposes a dual-branch feature extraction and weighted frequency fusion network using Transformer and convolutional neural networks. The central encoder enhances global feature representation, preserving structural integrity and preventing detail loss. A low-frequency LIA-Transformer module combines local importance attention with MLP Transformer to retain global structural features. A high-frequency reversible convolution module ensures detail retention via an inverted residual block. Finally, a weighted frequency fusion module adaptively fuses low- and high-frequency features through dynamic weight allocation to enhance detail clarity and information integrity. Experiments on multiple datasets show the proposed method outperforms existing ones in brightness preservation, edge clarity, and contrast, effectively improving fused image quality and reliability.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Remote-Sensing Image Classification · Infrared Target Detection Methodologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Harbin University of Science and Technology
Funding
Key R&D Program Guidance Projects of Heilongjiang Province
References (54)
Show source-provided references
1. 10.1007/s00158-022-03425-410.1007/s00158-022-03425-4 ↗
2. 10.1109/TIP.2020.297598410.1109/TIP.2020.2975984 ↗
3. 10.1016/j.inffus.2019.07.00510.1016/j.inffus.2019.07.005 ↗
4. 10.1109/TAI.2022.315130710.1109/TAI.2022.3151307 ↗
5. 10.1016/j.image.2020.11581210.1016/j.image.2020.115812 ↗
6. 10.23919/FUSION43075.2019.901125310.23919/FUSION43075.2019.9011253 ↗
7. 10.1007/s11042-018-6974-510.1007/s11042-018-6974-5 ↗
8. 10.1109/JSTARS.2021.306149610.1109/JSTARS.2021.3061496 ↗
9. 10.1109/ICITECH.2017.807994510.1109/ICITECH.2017.8079945 ↗
10. 10.1080/10589759.2024.242193810.1080/10589759.2024.2421938 ↗
11. 10.1016/j.inffus.2016.02.00110.1016/j.inffus.2016.02.001 ↗
12. 10.1016/j.infrared.2020.10362610.1016/j.infrared.2020.103626 ↗
13. 10.1016/j.inffus.2021.06.00810.1016/j.inffus.2021.06.008 ↗
14. 10.1109/JSTARS.2022.314021110.1109/JSTARS.2022.3140211 ↗
15. 10.1109/LGRS.2019.290772110.1109/LGRS.2019.2907721 ↗
16. 10.1016/j.optlaseng.2021.10677610.1016/j.optlaseng.2021.106776 ↗
17. 10.1109/TGRS.2022.315604110.1109/TGRS.2022.3156041 ↗
18. 10.1016/j.jvcir.2022.10348510.1016/j.jvcir.2022.103485 ↗
19. 10.1109/TGRS.2023.324567410.1109/TGRS.2023.3245674 ↗
20. 10.1016/j.inffus.2021.02.01910.1016/j.inffus.2021.02.019 ↗
21. 10.1016/j.infrared.2023.10485310.1016/j.infrared.2023.104853 ↗
22. 10.1109/TIP.2018.288734210.1109/TIP.2018.2887342 ↗
23. 10.1109/JAS.2022.10568610.1109/JAS.2022.105686 ↗
24. 10.1109/TCSVT.2023.323434010.1109/TCSVT.2023.3234340 ↗
25. 10.48550/arXiv.2211.1446110.48550/arXiv.2211.14461 ↗
26. 10.1016/j.ins.2019.08.06610.1016/j.ins.2019.08.066 ↗
27. 10.1109/TCI.2019.295687310.1109/TCI.2019.2956873 ↗
28. 10.1016/j.ins.2017.09.01010.1016/j.ins.2017.09.010 ↗
29. 10.1109/TBME.2012.221749310.1109/TBME.2012.2217493 ↗
30. 10.1016/j.ijleo.2022.16910210.1016/j.ijleo.2022.169102 ↗
31. 10.1016/j.image.2021.11640010.1016/j.image.2021.116400 ↗
32. 10.1016/j.ins.2022.05.01810.1016/j.ins.2022.05.018 ↗
33. 10.1016/j.infrared.2024.10521810.1016/j.infrared.2024.105218 ↗
34. 10.1016/j.inffus.2021.02.02310.1016/j.inffus.2021.02.023 ↗
35. 10.1016/j.inffus.2022.10.03410.1016/j.inffus.2022.10.034 ↗
36. 10.1016/j.inffus.2020.11.00910.1016/j.inffus.2020.11.009 ↗
37. 10.1016/j.inffus.2023.10186310.1016/j.inffus.2023.101863 ↗
38. 10.1016/j.ndteint.2025.10336110.1016/j.ndteint.2025.103361 ↗
39. 10.1016/j.infrared.2024.10520910.1016/j.infrared.2024.105209 ↗
40. 10.1109/ICIP46576.2022.989728010.1109/ICIP46576.2022.9897280 ↗
41. 10.1016/j.patcog.2022.10929510.1016/j.patcog.2022.109295 ↗
42. 10.1007/978-981-97-8692-3_410.1007/978-981-97-8692-3_4 ↗
43. 10.1007/978-981-19-6052-9_1310.1007/978-981-19-6052-9_13 ↗
44. 10.1016/j.imavis.2024.10539910.1016/j.imavis.2024.105399 ↗
45. 10.48550/arXiv.2301.0114610.48550/arXiv.2301.01146 ↗
46. 10.1117/1.OE.51.1.01090110.1117/1.OE.51.1.010901 ↗
47. 10.1109/CVPR52688.2022.0190610.1109/CVPR52688.2022.01906 ↗
48. 10.1016/j.inffus.2022.03.00710.1016/j.inffus.2022.03.007 ↗
49. 10.48550/arXiv.2003.0921010.48550/arXiv.2003.09210 ↗
50. 10.1007/s11263-021-01501-810.1007/s11263-021-01501-8 ↗
51. 10.1109/CVPR52688.2022.0057110.1109/CVPR52688.2022.00571 ↗
52. 10.48550/arXiv.2410.1227410.48550/arXiv.2410.12274 ↗
53. 10.1007/978-3-031-19797-0_3110.1007/978-3-031-19797-0_31 ↗
54. 10.1109/TPAMI.2020.301254810.1109/TPAMI.2020.3012548 ↗