journal article·2020-08-26Open access

Overview of Compressed Sensing: Sensing Model, Reconstruction Algorithm, and Its Applications

Lixiang Li, Yuan Fang, Liwei Liu, Haipeng Peng, Jürgen Kurths, Yixian Yang

Applied Sciences· Volume 10· Issue 17

Abstract

With the development of intelligent networks such as the Internet of Things, network scales are becoming increasingly larger, and network environments increasingly complex, which brings a great challenge to network communication. The issues of energy-saving, transmission efficiency, and security were gradually highlighted. Compressed sensing (CS) helps to simultaneously solve those three problems in the communication of intelligent networks. In CS, fewer samples are required to reconstruct sparse or compressible signals, which breaks the restrict condition of a traditional Nyquist–Shannon sampling theorem. Here, we give an overview of recent CS studies, along the issues of sensing models, reconstruction algorithms, and their applications. First, we introduce several common sensing methods for CS, like sparse dictionary sensing, block-compressed sensing, and chaotic compressed sensing. We also present several state-of-the-art reconstruction algorithms of CS, including the convex optimization, greedy, and Bayesian algorithms. Lastly, we offer recommendation for broad CS applications, such as data compression, image processing, cryptography, and the reconstruction of complex networks. We discuss works related to CS technology and some CS essentials.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sparse and Compressive Sensing Techniques · Advanced MRI Techniques and Applications · Microwave Imaging and Scattering Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Information Security Center, State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China

School of Computer Science and Technology, Henan Polytechnic University, 2001 Century Avenue, Jiaozuo 454003, China

Potsdam Institute for Climate Impact Research, D14473 Potsdam, Germany

Guizhou University, Guizhou Provincial Key Laboratory of Public Big Data, Guiyang 550025, China

Funding

National Natural Science Foundation of China

References (90)

Show source-provided references
1. Compressed sensing10.1109/TIT.2006.871582 ↗
2. A note on guaranteed sparse recovery via l1-minimization10.1016/j.acha.2009.10.004 ↗
3. Generalized DFT-s-OFDM waveforms without Cyclic Prefix10.1109/ACCESS.2017.2781122 ↗
4. Insights into IoT data and an innovative DWT-based technique to denoise sensor signals10.1109/JSEN.2017.2767383 ↗
5. Sensor pattern noise estimation based on improved locally adaptive DCT filtering and weighted averaging for source camera identification and verification view document10.1109/TIFS.2016.2620280 ↗
6. Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information10.1109/TIT.2005.862083 ↗
7. Jia, T., Chen, D., Wang, J., and Xu, D. (2018). Single-pixel color imaging method with a compressive sensing measurement matrix. Appl. Sci., 8.10.3390/app8081293 ↗
8. Sun, T., Li, J., and Blondel, P. (2019). Direct under-sampling compressive sensing method for underwater echo signals and physical implementation. Appl. Sci., 9.10.3390/app9214596 ↗
9. Alternating optimization of sensing matrix and sparsifying dictionary for compressed sensing10.1109/TSP.2015.2399864 ↗
10. Learning to sense sparse signals: Simultaneous sensing matrix and sparsifying dictionary optimization10.1109/TIP.2009.2022459 ↗
11. Prospective acceleration of diffusion tensor imaging with compressed sensing using adaptive dictionaries10.1002/mrm.25876 ↗
12. Zhang, B., Liu, Y., Zhuang, J., and Yang, L. (2017, January 10–13). A novel block compressed sensing based on matrix permutation. Proceedings of the IEEE Visual Communications and Image Processing, St. Petersburg, FL, USA.10.1109/VCIP.2016.7805531 ↗
13. An analysis of block sampling strategies in compressed sensing10.1109/TIT.2016.2524628 ↗
14. Coluccia, G., Diego, V., and Enrico, M. (October, January 30). Smoothness-constrained image recovery from block-based random projections. Proceedings of the IEEE 15th International Workshop on Multimedia Signal Processing, Pula, Italy.
15. Li, X., Bao, L., Zhao, D., Li, D., and He, W. (2012, January 29–31). The analyses of an improved 2-order Chebyshev chaotic sequence. Proceedings of the IEEE 2012 2nd International Conference on Computer Science and Network Technology, Changchun, China.
16. A novel secure data transmission scheme using chaotic compressed sensing10.1109/ACCESS.2017.2780323 ↗
17. Secure and energy-efficient data transmission system based on chaotic compressive sensing in body-to-body networks10.1109/TBCAS.2017.2665659 ↗
18. Research of incoherence rotated chaotic measurement matrix in compressed sensing10.1007/s11042-015-2953-2 ↗
19. Adler, A., Boublil, D., Elad, M., and Zibulevsky, M. (2016). A deep learning approach to block-based compressed sensing of images. arXiv.10.1109/MMSP.2017.8122281 ↗
20. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel.
21. Mun, S., and Fowler, J.E. (2010, January 26–29). Block compressed sensing of images using directional transforms. Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong, China.10.1109/DCC.2010.90 ↗
22. Fowler, J.E., Mun, S., and Tramel, E.W. (September, January 29). Multiscale block compressed sensing with smoothed projected Landweber reconstruction. Proceedings of the 19th European Signal Processing Conference, Barcelona, Spain.
23. Chen, C., Tramel, E.W., and Fowler, J.E. (2012, January 4–7). Compressed-sensing recovery of images and video using multihypothesis predictions. Proceedings of the IEEE 2012 46th Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA.10.1109/ACSSC.2011.6190204 ↗
24. Cui, W., Jiang, F., Gao, X., Tao, W., and Zhao, D. (2018). Deep neural network based sparse measurement matrix for image compressed sensing. arXiv.10.1109/ICIP.2018.8451841 ↗
25. A deep learning framework of quantized compressed sensing for wireless neural recording10.1109/ACCESS.2016.2604397 ↗
26. Semi-tensor product of matrices and its application to Morgen’s problem
27. On semi-tensor product of matrices and its applications10.1007/s10255-003-0097-z ↗
28. A survey on semi-tensor product of matrices10.1007/s11424-007-9027-0 ↗
29. Semi-tensor product of matrices and its some applications to physics
30. Semi-tensor compressed sensing10.1016/j.dsp.2016.07.003 ↗
31. Semitensor product compressive sensing for big data transmission in wireless sensor networks10.1155/2017/8158465 ↗
32. Low storage space for compressive sensing: Semi-tensor product approach10.1186/s13640-017-0199-9 ↗
33. P-tensor Product in Compressed Sensing10.1109/JIOT.2018.2886841 ↗
34. Nouasria, H., and Tolba, M.E. (2018, January 2–7). New sensing approach for compressive sensing using sparsity domain. Proceedings of the 19th IEEE Mediterranean Electrotechnical Conference, Marrakech, Morocco.10.1109/MELCON.2018.8379061 ↗
35. Compressed sensing with structured sparsity and structured acquisition10.1016/j.acha.2017.05.005 ↗
36. Ishikawa, S., Wu, W., and Lang, Y. (2018, January 7–9). A novel method for designing compressed sensing matrix. Proceedings of the IEEE International Workshop on Advanced Image Technology, Chiang Mai, Thailand.10.1109/IWAIT.2018.8369747 ↗
37. Atomic decomposition by basis pursuit10.1137/S003614450037906X ↗
38. Wang, J., Zhang, J., Chen, C., and Tian, F. (2014, January 3–5). Basic pursuit of an adaptive impulse dictionary for bearing fault diagnosis. Proceedings of the 2014 IEEE International Conference on Mechatronics and Control, Jinzhou, China.10.1109/ICMC.2014.7232004 ↗
39. A fast approach for overcomplete sparse decomposition based on smoothed l0-norm10.1109/TSP.2008.2007606 ↗
40. Synthesis of pattern reconfigurable sparse arrays with multiple measurement vectors FOCUSS method10.1109/TAP.2016.2640182 ↗
41. Theoretical results on sparse representations of multiple-measurement vectors10.1109/TSP.2006.881263 ↗
42. Algorithms to approximately solve NP hard row-sparse MMV recovery problem: Application to compressive color imaging10.1109/JETCAS.2012.2212774 ↗
43. Theoretical and empirical results for recovery from multiple measurements10.1109/TIT.2010.2043876 ↗
44. Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems10.1109/JSTSP.2007.910281 ↗
45. Sparse reconstruction by separable approximation10.1109/TSP.2009.2016892 ↗
46. Matching pursuits with time-frequency dictionaries10.1109/78.258082 ↗
47. Signal recovery from random measurements via orthogonal matching pursuit10.1109/TIT.2007.909108 ↗
48. Sparse solution of underdetermined systems of linear equations by stagewise orthogonal matching pursuit10.1109/TIT.2011.2173241 ↗
49. Uniform uncertainty principle and signal recovery via regularized orthogonal matching pursuit10.1007/s10208-008-9031-3 ↗
50. Cosamp: Iterative signal recovery from incomplete and inaccurate samples10.1016/j.acha.2008.07.002 ↗
51. Iterative hard thresholding for compressed sensing10.1016/j.acha.2009.04.002 ↗
52. A sharp ocndition for exact support recovery with orthogonal matching pursuit10.1109/TSP.2016.2634550 ↗
53. Generalized orthogonal matching pursuit10.1109/TSP.2012.2218810 ↗
54. The orthogonal super greedy algorithm and applications in compressed sensing10.1109/TIT.2011.2177632 ↗
55. Super greedy type algorithms10.1007/s10444-011-9220-5 ↗
56. Recovery of sparse signals via generalized orthogonal matching pursuit: A new analysis10.1109/TSP.2015.2498132 ↗
57. Zayyani, H., Babaie, M., and Jutten, C. (April, January 31). Decoding real-field codes by an iterative Expectation-Maximization (EM) algorithm. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas, NV, USA.
58. Bayesian compressive sensing10.1109/TSP.2007.914345 ↗
59. Sparse Bayesian learning for basis selection10.1109/TSP.2004.831016 ↗
60. An empirical Bayesian strategy for solving the simultaneous sparse approximation problem10.1109/TSP.2007.894265 ↗
61. Pattern-coupled sparse Bayesian learning for recovery of block-sparse signals10.1109/TSP.2014.2375133 ↗
62. Sparse Bayesian learning and the relevance vector machine
63. From denoising to compressed sensing10.1109/TIT.2016.2556683 ↗
64. Mousavi, A., Patel, A.B., and Baraniuk, R.G. (October, January 29). A deep learning approach to structured signal recovery. Proceedings of the 53rd Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, USA.
65. Kulkarni, K., Lohit, S., Turaga, P., Kerviche, R., and Ashok, A. (2016, January 27–30). ReconNet: Non-Iterative reconstruction of images from compressively sensed measurements. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.55 ↗
66. Mousavi, A., and Baraniuk, R.G. (2017, January 5–9). Learning to invert: Signal recovery via deep convolutional networks. Proceedings of the IEEE IEEE International Conference on Acoustics, Speech and Signal Processing, New Orleans, LA, USA.10.1109/ICASSP.2017.7952561 ↗
67. Metzler, C.A., Maleki, A., and Baraniuk, R.G. (2017). Learned DAMP: Principled neural-network-based compressive image recovery. arXiv.
68. AMP-Inspired deep networks for sparse linear inverse problems10.1109/TSP.2017.2708040 ↗
69. Rangan, S., Schniter, P., and Fletcher, A.K. (2016). Vector approximate message passing. arXiv.10.1109/ISIT.2017.8006797 ↗
70. Yao, H.T., Dai, F., Zhang, D.M., Ma, Y., Zhang, S.L., Zhang, Y.D., and Qi, T. (2017, January 21–26). DR2-Net:deep residual reconstruction network for image compressive sensing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
71. Bora, A., Jalal, A., and Price, E. (2017, January 6–11). Compressed sensing using generative models. Proceedings of the International Conference on Machine Learning, Sydney, Australia.
72. Zhang, J., and Ghanem, B. (2018, January 18–22). ISTA-Net: Interpretable Optimization-Inspired deep network for image compressive sensing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00196 ↗
73. Shi, W., Jiang, F., Liu, S., and Zhao, D. (2019, January 15–20). Scalable convolutional neural network for image compressed sensing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01257 ↗
74. Unde, A.S., Malla, R., and Deepthi, P.P. (2016, January 3–5). Low complexity secure encoding and joint decoding for distributed compressive sensing WSNs. Proceedings of the IEEE International Conference on Recent Advances in Information Technology, Dhanbad, India.10.1109/RAIT.2016.7507881 ↗
75. Energy efficient transmission approach for WBAN based on threshold distance10.1109/JSEN.2015.2435814 ↗
76. Xue, W., Luo, C., Lan, G., Rana, R., Hu, W., and Seneviratne, A. (2017, January 18–21). Kryptein: A compressive-sensing-based encryption scheme for the internet of things. Proceedings of the ACM/IEEE International Conference on Information Processing in Sensor Networks, Pittsburgh, PA, USA.10.1145/3055031.3055079 ↗
77. Orsdemir, A., Altun, H.O., and Sharma, G. (2008, January 16–19). On the security and robustness of encryption via compressed sensing. Proceedings of the IEEE Military Communications Conference, San Diego, CA, USA.10.1109/MILCOM.2008.4753187 ↗
78. Semi-fragile watermarking for image authentication based on compressive sensing10.1007/s11432-016-5542-8 ↗
79. A compressive sensing based privacy preserving outsourcing of image storage and identity authentication service in cloud10.1016/j.ins.2016.09.045 ↗
80. Identification of coupled map lattice based on compressed sensing10.1155/2016/6435320 ↗
81. Reconstruction of Complex Network based on the Noise via QR Decomposition and Compressed Sensing10.1038/s41598-017-15181-3 ↗
82. Fang, Y., Li, L., Li, Y., Peng, H., and Yang, Y. (2020). Low energy consumption compressed spectrum sensing based on channel energy reconstruction in cognitive radio network. Sensors, 20.10.3390/s20051264 ↗
83. Pilot allocation for distributed-compressed-sensing-based sparse channel estimation in MIMO-OFDM systems10.1109/TVT.2015.2441743 ↗
84. Structured compressive sensing-based spatio-temporal joint channel estimation for FDD massive MIMO10.1109/TCOMM.2015.2508809 ↗
85. A compressed sensing framework for Monte Carlo transport simulations using random disjoint tallies10.1080/23324309.2016.1156550 ↗
86. Hardware-algorithms co-design and implementation of an analog-to-information converter for biosignals based on compressed sensing10.1109/TBCAS.2015.2444276 ↗
87. Efficient and robust image coding and transmission based on scrambled block compressive sensing
88. Multifrequency compressed sensing for 2-D near-field synthetic aperture radar image reconstruction10.1109/TIM.2017.2654578 ↗
89. An overview of satellite synthetic aperture radar remote sensing in archaeology: From site detection to monitoring10.1016/j.culher.2015.05.003 ↗
90. Monitoring the tabular icebergs C28A and C28B calved from the Mertz Ice Tongue using radar remote sensing data10.1016/j.rse.2018.07.028 ↗