journal article·2026-02-07Open access

A Spatial–Spectral Decoupled Transformer Framework for Super-Resolution of Low-Earth-Orbit Multispectral Satellite Imagery

Duhui Yun, Seok-Teak Yun

Applied Sciences· Volume 16· Issue 4

Abstract

Multispectral (MS) satellite imagery provides rich spectral information for surface and atmospheric interpretation, yet its spatial resolution is often limited by sensor design. In this study, we propose a Transformer-based MS super-resolution framework that uses high-resolution panchromatic (PAN) imagery to supply complementary spatial detail cues for MS reconstruction and explicitly separates spatial enhancement from spectral preservation. In the spatial branch, PAN features are aligned to the MS grid via Pixel-Unshuffle and encoded with shifted-window self-attention to capture long-range spatial dependencies efficiently. In the spectral branch, spectral self-attention treats bands as tokens to learn inter-band correlations and maintain spectral consistency. The two representations are fused through channel concatenation and a 1 × 1 convolutional module, followed by a reconstruction head that upsamples the fused features to generate high-resolution MS outputs. For training, low-resolution MS inputs are synthesized from KOMPSAT-3A MS imagery using a degradation pipeline that combines modulation transfer function-based blur, downsampling, and additive Gaussian noise; the operation order is randomly permuted to emulate diverse acquisition conditions. In addition, Bayesian optimization is employed to explore network configurations through jointly considering the normalized mean absolute error and inference time. Experiments demonstrate that the proposed approach attains 46.23 dB PSNR, 0.9735 SSIM, and 3.12 ERGAS with approximately 167.4 K parameters, achieving a high restoration quality and computational efficiency across diverse degradation settings.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image Fusion Techniques · Satellite Image Processing and Photogrammetry · Advanced Image Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Aerospace Engineering, Gyeongsang National University, Jinju 52828, Republic of Korea

Funding

Research Resurgence under the Glocal University 30 Project

References (36)

Show source-provided references
1. Multisensor image fusion in remote sensing: Concepts, methods and applications10.1080/014311698215748 ↗
2. Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis: Practical discussion and challenges10.1016/j.inffus.2018.05.006 ↗
3. Resolution enhancement of multispectral image data to improve classification accuracy
4. Image Super-Resolution Using Deep Convolutional Networks10.1109/TPAMI.2015.2439281 ↗
5. Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27–30). Accurate Image Super-Resolution Using Very Deep Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.182 ↗
6. Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 21–26). Enhanced Deep Residual Networks for Single Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.151 ↗
7. Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18–23). Residual Dense Network for Image Super-Resolution. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00262 ↗
8. Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
9. Image Super-Resolution Using Very Deep Residual Channel Attention Networks
10. Mei, Y., Fan, Y., Zhou, Y., Huang, L., Huang, T.S., and Shi, H. (2020, January 13–19). Image Super-Resolution With Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00573 ↗
11. Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., and Gao, W. (2021, January 20–25). Pre-trained image processing transformer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01212 ↗
12. Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., and Timofte, R. (2021, January 11–17). SwinIR: Image restoration using Swin Transformer. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), Montreal, QC, Canada.10.1109/ICCVW54120.2021.00210 ↗
13. Chen, X., Wang, X., Zhou, J., Qiao, Y., and Dong, C. (2023, January 18–22). Activating more pixels in image super-resolution transformer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.02142 ↗
14. Zhu, C., Liu, Y., Huang, S., and Wang, F. (2025). Taming a Diffusion Model to Revitalize Remote Sensing Image Super-Resolution. Remote Sens., 17.10.3390/rs17081348 ↗
15. Multi-level Priors-Guided Diffusion-based Remote Sensing Image Super-Resolution10.1016/j.isprsjprs.2025.07.020 ↗
16. Enhanced Deep Image Prior for Unsupervised Hyperspectral Image Super-Resolution
17. A survey of pansharpening methods with a new band-decoupled variational model10.1016/j.isprsjprs.2016.12.013 ↗
18. Zhou, H., Liu, Q., and Wang, Y. (2022, January 18–22). PanFormer: A Transformer Based Model for Pan-Sharpening. Proceedings of the 2022 IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan.10.1109/ICME52920.2022.9859770 ↗
19. Hyperspectral Pansharpening: A Review10.1109/MGRS.2015.2440094 ↗
20. Multiresolution-based image fusion with additive wavelet decomposition10.1109/36.763274 ↗
21. Comparison of three different methods to merge multiresolution and multispectral data: TM & SPOT pan
22. Yang, J., Fu, X., Hu, Y., Huang, Y., Ding, X., and Paisley, J. (2017, January 22–29). PanNet: A deep network architecture for pan-sharpening. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.193 ↗
23. Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by Convolutional Neural Networks. Remote Sens., 8.10.3390/rs8070594 ↗
24. Wang, W., Liu, H., and Xie, G. (2021). Pansharpening of WorldView-2 Data via Graph Regularized Sparse Coding and Adaptive Coupled Dictionary. Sensors, 21.10.3390/s21113586 ↗
25. Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics10.1109/TGRS.2007.912448 ↗
26. A Critical Comparison Among Pansharpening Algorithms10.1109/TGRS.2014.2361734 ↗
27. Tsukamoto, N., Sugaya, Y., and Omachi, S. (2020). Spectrum Correction Using Modeled Panchromatic Image for Pansharpening. J. Imaging, 6.10.3390/jimaging6040020 ↗
28. Comparison of IKONOS and QuickBird images for mapping mangrove species on the Caribbean coast of Panama10.1016/j.rse.2004.04.005 ↗
29. Unsupervised multimodal remote sensing image registration via domain adaptation10.1109/TGRS.2023.3333889 ↗
30. Yang, K., Li, G., and Cheng, Y. (2017). Remote sensing image registration using multiple image features and local linear transformations. Remote Sens., 9.10.20944/preprints201705.0027.v2 ↗
31. A survey on vision transformer10.1109/TPAMI.2022.3152247 ↗
32. Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., and Li, H. (2022, January 19–24). Uformer: A general U-shaped transformer for image restoration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01716 ↗
33. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
34. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.-H. (2022, January 19–24). Restormer: Efficient transformer for high-resolution image restoration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00564 ↗
35. Single Image Super-Resolution via a Holistic Attention Network
36. A pan-sharpening model using dual-branch attention-guided diffusion networks10.1016/j.inffus.2025.103076 ↗