Pansharpening by Complementing Compressed Sensing with Spectral Correction
Source abstract
Abstract
Pansharpening (PS) is a process used to generate high-resolution multispectral (MS) images from high-spatial-resolution panchromatic (PAN) and high-spectral-resolution multispectral images. In this paper, we propose a method for pansharpening by focusing on a compressed sensing (CS) technique. The spectral reproducibility of the CS technique is high due to its image reproducibility, but the reproduced image is blurry. Although methods of complementing this incomplete reproduction have been proposed, it is known that the existing method may cause ringing artifacts. On the other hand, component substitution is another technique used for pansharpening. It is expected that the spatial resolution of the images generated by this technique will be as high as that of the high-resolution PAN image, because the technique uses the corrected intensity calculated from the PAN image. Based on these facts, the proposed method fuses the intensity obtained by the component substitution method and the intensity obtained by the CS technique to move the spatial resolution of the reproduced image close to that of the PAN image while reducing the spectral distortion. Experimental results showed that the proposed method can reduce spectral distortion and maintain spatial resolution better than the existing methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Image and Signal Denoising Methods · Advanced Image Processing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Graduate School of Engineering, Tohoku University, Sendai, Miyagi 980-8579, Japan
Funding
Japan Society for the Promotion of Science · Ministry of Education, Culture, Sports, Science and Technology
References (43)
Show source-provided references
1. A survey of classical methods and new trends in pansharpening of multispectral images10.1186/1687-6180-2011-79 ↗
2. A critical comparison among pansharpening algorithms10.1109/TGRS.2014.2361734 ↗
3. Multisource and multitemporal data fusion in remote sensing: A comprehensive review of the state of the art10.1109/MGRS.2018.2890023 ↗
4. Review article Multisensor image fusion in remote sensing: Concepts, methods and applications10.1080/014311698215748 ↗
5. A new look at IHS-like image fusion methods10.1016/S1566-2535(01)00036-7 ↗
6. A wavelet transform method to merge Landsat TM and SPOT panchromatic data10.1080/014311698215973 ↗
7. Laben, C.A., and Brower, B.V. (2000). Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening. (6,011,875), U.S. Patent.
8. A theory for multiresolution signal decomposition: The wavelet representation10.1109/34.192463 ↗
9. The Discrete Wavelet Transform: Wedding the À Trous and Mallat Algorithms10.1109/78.157290 ↗
10. The Laplacian Pyramid as a Compact Image Code10.1109/TCOM.1983.1095851 ↗
11. Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis10.1109/TGRS.2002.803623 ↗
12. Multifocus image fusion using the nonsubsampled contourlet transform10.1016/j.sigpro.2009.01.012 ↗
13. Image super-resolution via sparse representation10.1109/TIP.2010.2050625 ↗
14. Image Super—Resolution Using Deep Convolutional Networks10.1109/TPAMI.2015.2439281 ↗
15. Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by convolutional neural networks. Remote Sens., 8.10.3390/rs8070594 ↗
16. Pansharpening Based on Deconvolution for Multiband Filter Estimation10.1109/TGRS.2018.2858288 ↗
17. Convolutional Sparse Representation of Injected Details for Pansharpening10.1109/LGRS.2019.2904526 ↗
18. PAN-Guided Cross-Resolution Projection for Local Adaptive Sparse Representation-Based Pansharpening10.1109/TGRS.2019.2894702 ↗
19. The PAN and ms image pansharpening algorithm based on adaptive neural network and sparse representation in the NSST domain10.1109/ACCESS.2019.2910656 ↗
20. Pansharpening via Detail Injection Based Convolutional Neural Networks10.1109/JSTARS.2019.2898574 ↗
21. Compressed Sensing10.1109/TIT.2006.871582 ↗
22. A new pan-sharpening method using a compressed sensing technique10.1109/TGRS.2010.2067219 ↗
23. Remote sensing image fusion via sparse representations over learned dictionaries10.1109/TGRS.2012.2230332 ↗
24. A practical compressed sensing-based pan-sharpening method10.1109/LGRS.2011.2177063 ↗
25. Two-step sparse coding for the pan-sharpening of remote sensing images10.1109/JSTARS.2013.2283236 ↗
26. A sparse image fusion algorithm with application to pan-sharpening10.1109/TGRS.2012.2213604 ↗
27. Exploiting Joint Sparsity for Pansharpening: The J-SparseFI Algorithm10.1109/TGRS.2015.2504261 ↗
28. An online coupled dictionary learning approach for remote sensing image fusion10.1109/JSTARS.2014.2310781 ↗
29. Elad, M. (2010). Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing, Springer.10.1007/978-1-4419-7011-4 ↗
30. A pansharpening method based on the sparse representation of injected details10.1109/LGRS.2014.2331291 ↗
31. Remote Sensing Image Fusion Using Ripplet Transform and Compressed Sensing10.1109/LGRS.2014.2347955 ↗
32. Fusion of Panchromatic and Multispectral Images via Coupled Sparse Non-Negative Matrix Factorization10.1109/JSTARS.2015.2475754 ↗
33. Motion analysis for image enhancement: Resolution, occlusion, and transparency10.1006/jvci.1993.1030 ↗
34. An efficient pan sharpening via texture based dictionary learning and sparse representation10.1109/JSTARS.2018.2835573 ↗
35. Tsukamoto, N., Sugaya, Y., and Omachi, S. (2020). Spectrum Correction Using Modeled Panchromatic Image for Pansharpening. J. Imaging, 6.10.3390/jimaging6040020 ↗
36. Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images
37. A Universal Image Quality Index10.1109/97.995823 ↗
38. Ranchin, T., and Wald, L. (2000). Quality of high resolution synthesised images: Is there a simple criterion?. Proceedings of the Third Conference Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images, SEE/URISCA.
39. The spectral image processing system (SIPS)—Interactive visualization and analysis of imaging spectrometer data10.1016/0034-4257(93)90013-N ↗
40. Schölkopf, B., Platt, J.C., and Hoffman, T. (2006). Efficient sparse coding algorithms. Proceedings of the 19th International Conference on Neural Information Processing Systems, MIT Press.10.7551/mitpress/7503.001.0001 ↗
41. Optimal MMSE pan sharpening of very high resolution multispectral images10.1109/TGRS.2007.907604 ↗
42. An adaptive pansharpening method by using weighted least squares filter10.1109/LGRS.2015.2492569 ↗
43. Pansharpening for Multiband Images with Adaptive Spectral-Intensity Modulation10.1109/JSTARS.2018.2849011 ↗