A Lightweight Super-Resolution Network for Infrared Images Based on an Adaptive Attention Mechanism
Source abstract
Abstract
Infrared imaging technology has been widely adopted in various fields, such as military reconnaissance, medical diagnosis, and security monitoring, due to its excellent ability to penetrate smoke and fog. However, the prevalent low resolution of infrared images severely limits the accurate interpretation of their contents. In addition, deploying super-resolution models on resource-constrained devices faces significant challenges. To address these issues, this study proposes a lightweight super-resolution network for infrared images based on an adaptive attention mechanism. The network’s dynamic weighting module automatically adjusts the weights of the attention and non-attention branch outputs based on the network’s characteristics at different levels. Among them, the attention branch is further subdivided into pixel attention and brightness-texture attention, which are specialized for extracting the most informative features in infrared images. Meanwhile, the non-attention branch supplements the extraction of those neglected features to enhance the comprehensiveness of the features. Through ablation experiments, we verify the effectiveness of the proposed module. Finally, through experiments on two datasets, FLIR and Thermal101, qualitative and quantitative results demonstrate that the model can effectively recover high-frequency details of infrared images and significantly improve image resolution. In detail, compared with the suboptimal method, we have reduced the number of parameters by 30% and improved the model performance. When the scale factor is 2, the peak signal-to-noise ratio of the test datasets FLIR and Thermal101 is improved by 0.09 and 0.15 dB, respectively. When the scale factor is 4, it is improved by 0.05 and 0.09 dB, respectively. In addition, due to the lightweight design of the network structure, it has a low computational cost. It is suitable for deployment on edge devices, thus effectively enhancing the sensing performance of infrared imaging devices.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Advanced Image Processing Techniques · Image Enhancement Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (39)
Show source-provided references
1. Real-world single image super-resolution: a brief review10.1016/j.inffus.2021.09.005 ↗
2. Laikin · Lens design · 201810.1201/9780849382796 ↗
3. Deep learning for image super-resolution: a survey10.1109/TPAMI.2020.2982166 ↗
4. Satellite image super-resolution by 2D RRDB and edge-enhanced generative adversarial network10.3390/app122312311 ↗
5. Super-resolution imaging for infrared micro-scanning optical system10.1364/OE.27.007719 ↗
6. Single image super-resolution from transformed self-exemplars
7. Anchored neighborhood regression for fast example-based super-resolution
8. Image super-resolution via sparse representation10.1109/TIP.2010.2050625 ↗
9. Image super-resolution using deep convolutional networks10.1109/TPAMI.2015.2439281 ↗
10. Accelerating the super-resolution convolutional neural network
11. Accurate image super-resolution using very deep convolutional networks
12. Improved generative adversarial network for super-resolution reconstruction of coal photomicrographs10.3390/s23167296 ↗
13. Imagenet classification with deep convolutional neural networks
14. Enhanced deep residual networks for single image super-resolution
15. Image super-resolution using very deep residual channel attention networks
16. Deeply-recursive convolutional network for image super-resolution
17. Fast, accurate, and lightweight super-resolution with cascading residual network
18. Lightweight image super-resolution with information multi-distillation network
19. Residual feature distillation network for lightweight image super-resolution
20. Efficient image super-resolution using pixel attention
21. Improving convolutional networks with self-calibrated convolutions
22. Thermal image enhancement using convolutional neural network
23. Thermal image superresolution through deep convolutional neural network
24. Therisurnet-a computationally efficient thermal image super-resolution network
25. Channel split convolutional neural network (ChaSNet) for thermal image super-resolution
26. Super-resolution reconstruction of infrared images based on a convolutional neural network with skip connections10.1016/j.optlaseng.2021.106717 ↗
27. A multi-scale mixed convolutional network for infrared image super-resolution reconstruction10.1007/s11042-023-15359-0 ↗
28. Deep learning-based image super-resolution restoration for mobile infrared imaging system10.1016/j.infrared.2023.104762 ↗
29. Squeeze-and-excitation networks
30. Concurrent spatial and channel ‘squeeze & excitation’ in fully convolutional networks
31. CBAM: convolutional block attention module
32. Dual attention network for scene segmentation
33. ECA-Net: efficient channel attention for deep convolutional neural networks
34. Channel-wise and spatial feature modulation network for single image super-resolution10.1109/TCSVT.2019.2915238 ↗
35. Chen H, Gu J, Zhang Z. Attention in attention network for image super-resolution. arXiv:210409497. 2021.10.1016/j.patcog.2021.108349 ↗
36. Thermal image super-resolution: a novel architecture and dataset
37. Lapar: linearly-assembled pixel-adaptive regression network for single image super-resolution and beyond
38. Shufflemixer: an efficient convnet for image super-resolution
39. LIRSRN: a lightweight infrared image super-resolution network