Hyperspectral Image Inpainting Based on Robust Spectral Dictionary Learning
Source abstract
Abstract
To address the problems of defective pixels and strips in hyperspectral images affecting subsequent processing and applications, we modeled the hyperspectral image (HSI) inpainting problem as a sparse signal reconstruction problem with incomplete observations using the theory of sparse representation, and proposed an HSI inpainting algorithm based on spectral dictionary learning. First, we studied the HSI observation model under the assumption of additive noise. We subsequently proposed a new algorithm for constructing a spectral dictionary directly from hyperspectral data by introducing an online learning optimization method and performing dictionary learning using a robust function. Afterwards, the image was sparsely encoded by applying the variable decomposition and augmented Lagrangian sparse regression method. Finally, the inpainted HSI was obtained by sparse reconstruction. The experimental results showed that compared with the existing algorithms, the algorithm proposed herein could effectively inpaint the defective HSI under different noise conditions with a shorter calculation time than those of existing methods and other dictionary learning inpainting algorithms.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Image and Signal Denoising Methods · Remote-Sensing Image Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Science and Technology on Complex Electronic System Simulation Laboratory, Space Engineering University, Beijing 101416, China
Funding
National Natural Science Foundation of China
References (35)
Show source-provided references
1. Image Inpainting
2. Interpolation of missing data in image sequences10.1109/83.469932 ↗
3. Shih, T.K., Chang, R.C., Lu, L.C., Ko, W.C., and Wang, C.C. (2004, January 29–31). Adaptive Digital Image Inpainting. Proceedings of the International Conference on Advanced Information Networking and Applications, Fukuoka, Japan.
4. Grossauer, H. (2004, January 11–14). A Combined PDE and Texture Synthesis Approach to Inpainting. Proceedings of the 8th European Conference on Computer Vision, Prague, Czech Republic.10.1007/978-3-540-24671-8_17 ↗
5. Strong-continuation, contrast-invariant inpainting with a third-order optimal PDE10.1109/TIP.2006.877067 ↗
6. Zoom-based super-resolution reconstruction approach using prior total variation10.1117/1.2818797 ↗
7. A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video10.1155/2007/74585 ↗
8. Simultaneous total variation image inpainting and blind deconvolution10.1002/ima.20041 ↗
9. Wei, Y., Sun, J.X., Gang, Z., Teng, S., and Wen, G.J. (2010, January 27–29). PDE Image Inpainting with Texture Synthesis based on Damaged Region Classification. Proceedings of the International Conference on Advanced Computer Control, Shenyang, China.
10. A MAP-Based Algorithm for Destriping and Inpainting of Remotely Sensed Images10.1109/TGRS.2008.2005780 ↗
11. Universal reconstruction method for radiometric quality improvement of remote sensing images
12. Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations10.1109/JSTARS.2018.2796570 ↗
13. ℓ0-based sparse hyperspectral unmixing using spectral information and a multi-objectives formulation10.1016/j.isprsjprs.2018.04.008 ↗
14. CoinNet: Copy Initialization Network for Multispectral Imagery Semantic Segmentation10.1109/LGRS.2018.2880756 ↗
15. Fadili, M.J., and Starck, J.L. (2005, January 14). EM Algorithm for Sparse Representation-based Image Inpainting. Proceedings of the IEEE International Conference on Image Processing, Genova, Italy.10.1109/ICIP.2005.1529991 ↗
16. Shen, B., Wei, H., Zhang, Y., and Zhang, Y.J. (2009, January 19–24). Image inpainting via sparse representation. Proceedings of the IEEE International Conference on Acoustics, Taipei, Taiwan.
17. Nonparametric Bayesian dictionary learning for analysis of noisy and incomplete images10.1109/TIP.2011.2160072 ↗
18. Hyperspectral remote sensing data analysis and future challenges10.1109/MGRS.2013.2244672 ↗
19. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation10.1109/TSP.2006.881199 ↗
20. Compressed Sensing-Based Inpainting of Aqua Moderate Resolution Imaging Spectroradiometer Band 6 Using Adaptive Spectrum-Weighted Sparse Bayesian Dictionary Learning10.1109/TGRS.2013.2245509 ↗
21. Online Learning for Matrix Factorization and Sparse Coding
22. Interferometric Phase Image Estimation via Sparse Coding in the Complex Domain10.1109/TGRS.2014.2361919 ↗
23. Song, X., Wu, L., Hao, H., and Xu, W. (2019). Hyperspectral Image Denoising Based on Spectral Dictionary Learning and Sparse Coding. Electronics, 8.10.3390/electronics8010086 ↗
24. On the Role of Sparse and Redundant Representations in Image Processing10.1109/JPROC.2009.2037655 ↗
25. Toward a practical face recognition system: Robust alignment and illumination by sparse representation10.1109/TPAMI.2011.112 ↗
26. Lu, C., Shi, J., and Jia, J. (2013, January 23–28). Online Robust Dictionary Learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.60 ↗
27. Background Subtraction via Robust Dictionary Learning10.1155/2011/972961 ↗
28. Convergence analysis of generalized iteratively reweighted least squares algorithms on convex function spaces
29. Decoding by linear programming10.1109/TIT.2005.858979 ↗
30. D’Errico, J. (2019, April 15). Inpainting nan elements in 3-d. Available online: http://www.mathworks.com/matlabcentral/fileexchange/21214-inpaintingnan-elements-in-3-d.htm.
31. Schneider, C., and Gürenci, J. (2002). Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations, Springer.
32. Cerra, D., Müller, R., and Reinartz, P. (2014, January 13–18). Unmixing-based Denoising for Destriping and Inpainting of Hyperspectral Images. Proceedings of the Geoscience and Remote Sensing Symposium, Quebec City, QC, Canada.10.1109/IGARSS.2014.6947522 ↗
33. Hyperspectral image denoising using local low-rank matrix recovery and global spatial–spectral total variation10.1109/JSTARS.2018.2800701 ↗
34. Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art10.1109/MGRS.2017.2762087 ↗
35. A closed-form approximation of the exact unbiased inverse of the Anscombe variance-stabilizing transformation