Nonconvex Nonlinear Transformation of Low-Rank Approximation for Tensor Completion
Source abstract
Abstract
Recovering incomplete high-dimensional data to create complete and valuable datasets is the main focus of tensor completion research, which lies at the intersection of mathematics and information science. Researchers typically apply various linear and nonlinear transformations to the original tensor, using regularization terms like the nuclear norm for low-rank approximation. However, relying solely on the tensor nuclear norm can lead to suboptimal solutions because of the convex relaxation of tensor rank, which strays from the original outcomes. To tackle these issues, we introduce the low-rank approximation nonconvex nonlinear transformation (LRANNT) method. By employing nonconvex norms and nonlinear transformations, we can more accurately capture the intrinsic structure of tensors, providing a more effective solution to the tensor completion problem. Additionally, we propose the proximal alternating minimization (PAM) algorithm to solve the model, demonstrating its convergence. Tests on publicly available datasets demonstrate that our method outperforms the current state-of-the-art approaches, even under extreme conditions with a high missing rate of up to 97.5%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tensor decomposition and applications · Sparse and Compressive Sensing Techniques · Advanced Neuroimaging Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Sports Engineering, Beijing Sport University, Beijing 100084, China
Funding
National Natural Science Foundation of China · Fundamental Research Funds for Central Universities
References (42)
Show source-provided references
1. Low rank tensor completion with Poisson observations
2. Low-rank tensor completion using matrix factorization based on tensor train rank and total variation10.1007/s10915-019-01044-8 ↗
3. Low-rank tensor models for improved multidimensional MRI: Application to dynamic cardiac T1 mapping10.1109/TCI.2019.2940916 ↗
4. MRI denoising via sparse tensors with reweighted regularization10.1016/j.apm.2019.01.011 ↗
5. Low-rank tensor completion based on log-det rank approximation and matrix factorization10.1007/s10915-019-01009-x ↗
6. Exact matrix completion via convex optimization10.1145/2184319.2184343 ↗
7. Fast and accurate matrix completion via truncated nuclear norm regularization10.1109/TPAMI.2012.271 ↗
8. Recovering low-rank and sparse matrix based on the truncated nuclear norm10.1016/j.neunet.2016.09.005 ↗
9. An efficient randomized algorithm for computing the approximate Tucker decomposition10.1007/s10915-021-01545-5 ↗
10. A Riemannian optimization approach for solving the generalized eigenvalue problem for nonsquare matrix pencils10.1007/s10915-019-01102-1 ↗
11. The expression of a tensor or a polyadic as a sum of products10.1002/sapm192761164 ↗
12. Efficient tensor completion for color image and video recovery: Low-rank tensor train10.1109/TIP.2017.2672439 ↗
13. Yuan, L., Li, C., Mandic, D., Cao, J., and Zhao, Q. (February, January 27). Tensor ring decomposition with rank minimization on latent space: An efficient approach for tensor completion. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
14. Zhao, Q., Zhou, G., Xie, S., Zhang, L., and Cichocki, A. (2016). Tensor ring decomposition. arXiv.
15. Most tensor problems are NP-hard10.1145/2512329 ↗
16. Zhang, Z., Ely, G., Aeron, S., Hao, N., and Kilmer, M. (2014, January 23–28). Novel methods for multilinear data completion and de-noising based on tensor-SVD. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.485 ↗
17. Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging10.1137/110837711 ↗
18. Robust principal component analysis?
19. Factorization strategies for third-order tensors10.1016/j.laa.2010.09.020 ↗
20. Lu, C., Peng, X., and Wei, Y. (2019, January 15–20). Low-rank tensor completion with a new tensor nuclear norm induced by invertible linear transforms. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00615 ↗
21. Xu, W.H., Zhao, X.L., and Ng, M. (2019). A fast algorithm for cosine transform based tensor singular value decomposition. arXiv.
22. Tensor–tensor products with invertible linear transforms10.1016/j.laa.2015.07.021 ↗
23. Framelet representation of tensor nuclear norm for third-order tensor completion10.1109/TIP.2020.3000349 ↗
24. Robust tensor completion using transformed tensor singular value decomposition10.1002/nla.2299 ↗
25. Tensor Q-rank: New data dependent definition of tensor rank10.1007/s10994-021-05987-8 ↗
26. Low-rank tensor completion based on self-adaptive learnable transforms10.1109/TNNLS.2022.3215974 ↗
27. Nonlinear transform induced tensor nuclear norm for tensor completion10.1007/s10915-022-01937-1 ↗
28. Efficient recovery of low-rank matrix via double nonconvex nonsmooth rank minimization10.1109/TNNLS.2019.2900572 ↗
29. Nonconvex robust low-rank matrix recovery10.1137/18M1224738 ↗
30. Lu, C., Tang, J., Yan, S., and Lin, Z. (2014, January 23–28). Generalized nonconvex nonsmooth low-rank minimization. Proceedings of the IEEE Conference on Computer Vision and Pattern recognition, Columbus, OH, USA.10.1109/CVPR.2014.526 ↗
31. Low-Rank Tensor Completion based on Nonconvex Regularization10.1016/j.sigpro.2023.109157 ↗
32. Computing sparse representation in a highly coherent dictionary based on difference of L1 and L210.1007/s10915-014-9930-1 ↗
33. Folded-concave penalization approaches to tensor completion10.1016/j.neucom.2014.10.069 ↗
34. Enhanced nonconvex low-rank approximation of tensor multi-modes for tensor completion10.1109/TCI.2021.3053699 ↗
35. Tensor decompositions and applications10.1137/07070111X ↗
36. Denoising of hyperspectral images using nonconvex low rank matrix approximation10.1109/TGRS.2017.2706326 ↗
37. Nonconvex truncated nuclear norm minimization based on adaptive bisection method10.1109/TCSVT.2018.2878803 ↗
38. Nonconvex nonsmooth low rank minimization via iteratively reweighted nuclear norm10.1109/TIP.2015.2511584 ↗
39. Gaïffas, S., and Lecué, G. (2011). Weighted algorithms for compressed sensing and matrix completion. arXiv.
40. Krishnan, D., and Fergus, R. (2009). Fast image deconvolution using hyper-Laplacian priors. Adv. Neural Inf. Process. Syst., 22.
41. A singular value thresholding algorithm for matrix completion10.1137/080738970 ↗
42. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗