Fast and Stable Hyperspectral Multispectral Image Fusion Technique Using Moore–Penrose Inverse Solver
Source abstract
Abstract
Fusion low-resolution hyperspectral images (LR-HSI) and high-resolution multispectral images (HR-MSI) are important methods for obtaining high-resolution hyperspectral images (HR-HSI). Some hyperspectral image fusion application areas have strong real-time requirements for image fusion, and a fast fusion method is urgently needed. This paper proposes a fast and stable fusion method (FSF) based on matrix factorization, which can largely reduce the computational workloads of image fusion to achieve fast and efficient image fusion. FSF introduces the Moore–Penrose inverse in the fusion model to simplify the estimation of the coefficient matrix and uses singular value decomposition (SVD) to simplify the estimation of the spectral basis, thus significantly reducing the computational effort of model solving. Meanwhile, FSF introduces two multiplicative iterative processes to optimize the spectral basis and coefficient matrix to achieve stable and high-quality fusion. We have tested the fusion method on remote sensing and ground-based datasets. The experiments show that our proposed method can achieve the performance of several state-of-the-art algorithms while reducing execution time to less than 1% of such algorithms.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Remote-Sensing Image Classification · Geochemistry and Geologic Mapping
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of High Performance Computing, College of Computer Science, National University of Defense Technology, Changsha 410073, China
References (37)
Show source-provided references
1. Samiappan, S. (2014). Spectral Band Selection for Ensemble Classification of Hyperspectral Images with Applications to Agriculture and Food Safety, Mississippi State University.
2. Automated tongue segmentation in hyperspectral images for medicine10.1364/AO.46.008328 ↗
3. Pechanec, V., Mráz, A., Rozkošný, L., and Vyvlečka, P. (2021). Usage of Airborne Hyperspectral Imaging Data for Identifying Spatial Variability of Soil Nitrogen Content. ISPRS Int. J. Geoinf., 10.10.3390/ijgi10060355 ↗
4. Multi- and hyperspectral geologic remote sensing: A review
5. Cui, Y., Zhang, B., Yang, W., Yi, X., and Tang, Y. (2018, January 8–13). Deep CNN-based Visual Target Tracking System Relying on Monocular Image Sensing. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.10.1109/IJCNN.2018.8489650 ↗
6. Cui, Y., Zhang, B., Yang, W., Wang, Z., Li, Y., Yi, X., and Tang, Y. (2017, January 22–29). End-to-End Visual Target Tracking in Multi-robot Systems Based on Deep Convolutional Neural Network. Proceedings of the IEEE International Conference on Computer Vision Workshops, Venice, Italy.10.1109/ICCVW.2017.135 ↗
7. Irani, M., and Anandan, P. (1998, January 7). Robust Multi-Sensor Image Alignment. Proceedings of the Sixth International Conference on Computer Vision, Bombay, India.
8. The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data
9. An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets10.1109/TGRS.2008.916211 ↗
10. A Practical Compressed Sensing-Based Pan-Sharpening Method10.1109/LGRS.2011.2177063 ↗
11. Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images10.1109/TGRS.2009.2017737 ↗
12. Hyperspectral and Multispectral Image Fusion based on a Sparse Representation10.1109/TGRS.2014.2381272 ↗
13. A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization10.1109/TGRS.2014.2375320 ↗
14. MAP Estimation for Hyperspectral Image Resolution Enhancement Using an Auxiliary Sensor10.1109/TIP.2004.829779 ↗
15. Eismann, M.T. (2004). Resolution Enhancement of Hyperspectral Imagery Using Maximum a Posteriori Estimation with a Stochastic Mixing Model. [Ph.D. Thesis, University of Dayton].
16. Sparse Unmixing of Hyperspectral Data10.1109/TGRS.2010.2098413 ↗
17. Unmixing-based multisensor multiresolution image fusion10.1109/36.763276 ↗
18. Spatial resolution improvement by merging MERIS-ETM images for coastal water monitoring10.1109/LGRS.2005.861699 ↗
19. Grohnfeldt, C., and Bamler, R. (2013, January 21–26). Jointly Sparse Fusion of Hyperspectral and Multispectral Imagery. Proceedings of the 2013 IEEE International Geoscience and Remote Sensing Symposium—IGARSS, Melbourne, VIC, Australia.10.1109/IGARSS.2013.6723732 ↗
20. Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation10.1109/TIP.2016.2542360 ↗
21. Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion10.1109/TGRS.2011.2161320 ↗
22. Hyperspectral Image Super-Resolution via Subspace-Based Low Tensor Multi-Rank Regularization10.1109/TIP.2019.2916734 ↗
23. Hyperspectral Image Super-resolution via Subspace-based Fast Low Tensor Multi-Rank Regularization10.1016/j.infrared.2021.103631 ↗
24. Dong, W., Li, G., Shi, G., Xin, L., and Yi, M. (2015, January 7–13). Low-Rank Tensor Approximation with Laplacian Scale Mixture Modeling for Multiframe Image Denoising. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.58 ↗
25. Tensor completion for estimating missing values in visual data10.1109/TPAMI.2012.39 ↗
26. Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination10.1109/TPAMI.2015.2392756 ↗
27. Support Tensor Machines for Classification of Hyperspectral Remote Sensing Imagery10.1109/TGRS.2016.2514404 ↗
28. Fusing Hyperspectral and Multispectral Images via Coupled Sparse Tensor Factorization10.1109/TIP.2018.2836307 ↗
29. Dian, R., Fang, L., and Li, S. (2017, January 21–26). Hyperspectral Image Super-Resolution via Non-local Sparse Tensor Factorization. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.411 ↗
30. Hyperspectral Super-Resolution: A Coupled Tensor Factorization Approach10.1109/TSP.2018.2876362 ↗
31. He, W., Chen, Y., Yokoya, N., Li, C., and Zhao, Q. (2020). Hyperspectral Super-Resolution via Coupled Tensor Ring Factorization. arXiv.
32. Exploiting spectral and spatial information in hyperspectral urban data with high resolution10.1109/LGRS.2004.837009 ↗
33. Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum10.1109/TIP.2010.2046811 ↗
34. Learning a Low Tensor-Train Rank Representation for Hyperspectral Image Super-Resolution10.1109/TNNLS.2018.2885616 ↗
35. Wald, L. (2000). Quality of high resolution synthesised images: Is there a simple criterion?. Third Conference Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images, SEE/URISCA.
36. A universal image quality index10.1109/97.995823 ↗
37. Hyperspectral and multispectral data fusion: A comparative review of the recent literature10.1109/MGRS.2016.2637824 ↗