journal article·2022-04-08Open access

Prospects of Structural Similarity Index for Medical Image Analysis

Vicky Mudeng, Minseok Kim, Se-woon Choe

Applied Sciences· Volume 12· Issue 8

Abstract

An image quality matrix provides a significant principle for objectively observing an image based on an alteration between the original and distorted images. During the past two decades, a novel universal image quality assessment has been developed with the ability of adaptation with human visual perception for measuring the difference of a degraded image from the reference image, namely a structural similarity index. Structural similarity has since been widely used in various sectors, including medical image evaluation. Although numerous studies have reported the use of structural similarity as an evaluation strategy for computer-based medical images, reviews on the prospects of using structural similarity for medical imaging applications have been rare. This paper presents previous studies implementing structural similarity in analyzing medical images from various imaging modalities. In addition, this review describes structural similarity from the perspective of a family’s historical background, as well as progress made from the original to the recent structural similarity, and its strengths and drawbacks. Additionally, potential research directions in applying such similarities related to medical image analyses are described. This review will be beneficial in guiding researchers toward the discovery of potential medical image examination methods that can be improved through structural similarity index.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image and Video Quality Assessment · Radiomics and Machine Learning in Medical Imaging · Advanced Image Fusion Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Korea

Department of Electrical Engineering, Institute Teknologi Kalimantan, Balikpapan 76127, Indonesia

Department of Mechanical System Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea

Department of Aeronautics, Mechanical and Electronic Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea

Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Korea

Funding

National Research Foundation of Korea · the Brain Korea 21 FOUR Project

References (100+)

Show source-provided references
1. Modelling of subjective radiological assessments with objective image quality measures of brain and body CT images10.1007/978-3-319-20801-5_1 ↗
2. Thung, K.-H., and Raveendran, P. (2009, January 14–15). A survey of image quality measures. Proceedings of the 2009 International Conference for Technical Postgraduates (TECHPOS), Kuala Lumpur, Malaysia.10.1109/TECHPOS.2009.5412098 ↗
3. Semantic image analysis for intelligent image retrieval10.1016/j.procs.2015.04.169 ↗
4. Image decomposition-based structural similarity index for image quality assessment10.1186/s13640-016-0134-5 ↗
5. Structural similarity index family for image quality assessment in radiological images10.1117/1.JMI.4.3.035501 ↗
6. Hore, A., and Ziou, D. (2010, January 23–26). Image quality metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.10.1109/ICPR.2010.579 ↗
7. Mean squared error: Love it or leave it? A new look at signal fidelity measures10.1109/MSP.2008.930649 ↗
8. Lu, Y. (February, January 27). The level weighted structural similarity loss: A step away from MSE. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
9. Image quality measures and their performance10.1109/26.477498 ↗
10. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
11. Visualized numerical assessment for near infrared diffuse optical tomography with contrast-and-size detail analysis10.1007/s10043-013-0004-7 ↗
12. Contrast-detail analysis characterizing diffuse optical fluorescence tomography image reconstruction10.1117/1.2114727 ↗
13. On the mathematical properties of the structural similarity index10.1109/TIP.2011.2173206 ↗
14. A universal image quality index10.1109/97.995823 ↗
15. Similarity measurement on human mobility data with spatially weighted structural similarity index (SpSSIM)10.1111/tgis.12590 ↗
16. Chen, G., Yang, C., and Xie, S. (2006, January 8–11). Gradient-based structural similarity for image quality assessment. Proceedings of the 2006 International Conference on Image Processing, Atlanta, GA, USA.10.1109/ICIP.2006.313132 ↗
17. Improved structural similarity metric for the visible quality measurement of images10.1117/1.JEI.25.6.063015 ↗
18. Content-partitioned structural similarity index for image quality assessment10.1016/j.image.2010.03.004 ↗
19. Li, C., and Bovik, A.C. (2009, January 19). Three-component weighted structural similarity index. Proceedings of the SPIE 7242, Image Quality and System Performance VI, San Jose, CA, USA.10.1117/12.811821 ↗
20. Rouse, D.M., and Hemami, S.S. (2008, January 14). Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM. Proceedings of the SPIE 6806, Human Vision and Electronic Imaging XIII, San Jose, CA, USA.10.1117/12.768060 ↗
21. Complex wavelet structural similarity: A new image similarity index10.1109/TIP.2009.2025923 ↗
22. Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9–12). Multiscale structural similarity for image quality assessment. Proceedings of the Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA.
23. Design of a hybrid measure for image similarity: A statistical, algebraic, and information-theoretic approach10.1080/22797254.2019.1628617 ↗
24. Computational interference microscopy enabled by deep learning10.1063/5.0041901 ↗
25. Kumar, B., Kumar, S.B., and Kumar, C. (2013, January 9–11). Development of improved SSIM quality index for compressed medical images. Proceedings of the 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013), Shimla, India.10.1109/ICIIP.2013.6707593 ↗
26. Image reconstruction with the chaotic fiber laser in scattering media
27. Reducing image artifact in diffuse optical tomography by iterative perturbation correction based on multiwavelength measurements10.1117/1.JBO.24.5.056005 ↗
28. Brief review on learning-based methods for optical tomography10.1142/S1793545819300118 ↗
29. Joint optimization for SSIM-based CTU-level bit allocation and rate distortion optimization10.1109/TBC.2021.3068871 ↗
30. Zeng, K., and Wang, Z. (October, January 30). 3D-SSIM for video quality assessment. Proceedings of the 2012 19th IEEE International Conference on Image Processing, Orlando, FL, USA.10.1109/ICIP.2012.6466936 ↗
31. Dowling, J.A., Planitz, B.M., Maeder, A.J., Du, J., Pham, B., Boyd, C., Chen, S., Bradley, A.P., and Crozier, S. (2007, January 8). Visual quality assessment of watermarked medical images. Proceedings of the SPIE 6515, Medical Imaging 2007: Image Perception, Observer Performance, and Technology Assessment, San Diego, CA, USA.10.1117/12.707571 ↗
32. Video quality assessment based on structural distortion measurement10.1016/S0923-5965(03)00076-6 ↗
33. Chen, S., Zhang, Y., Li, Y., Chen, Z., and Wang, Z. (2018, January 23–27). Spherical structural similarity index for objective omnidirectional video quality assessment. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.10.1109/ICME.2018.8486584 ↗
34. Design of objective video quality metrics using spatial and temporal informations10.1109/TLA.2015.7069106 ↗
35. Objective video quality assessment methods: A classification, review, and performance comparison10.1109/TBC.2011.2104671 ↗
36. Comparison of Objective image quality metrics to expert radiologists’ scoring of diagnostic quality of MR images10.1109/TMI.2019.2930338 ↗
37. Compressed sensing-based MRI reconstruction using complex double-density dual-tree DWT10.1155/2013/907501 ↗
38. Deep artifact suppression for spiral real-time phase contrast cardiac magnetic resonance imaging in congenital heart disease10.1016/j.mri.2021.08.005 ↗
39. Fast and accurate reconstruction of human lung gas MRI with deep learning10.1002/mrm.27889 ↗
40. Analysis of denoising filters on MRI brain images10.1002/ima.22225 ↗
41. Kuanar, S., Athitsos, V., Mahapatra, D., Rao, K.R., Akhtar, Z., and Dasgupta, D. (2019, January 22–25). Low dose abdominal CT image reconstruction: An unsupervised learning based approach. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.10.1109/ICIP.2019.8803037 ↗
42. Elaiyaraja, G., Kumaratharan, N., and Rao, T.C.S. (2019). Fast and efficient filter using wavelet threshold for removal of Gaussian noise from MRI/CT scanned medical images/color video sequence. IETE J. Res., 1–13.10.1080/03772063.2019.1579679 ↗
43. Kim, W., and Byun, B.H. (2018, January 10–17). Contrast CT image generation model using CT image of PET/CT. Proceedings of the 2018 IEEE Nuclear Science Symposium and Medical Imaging Conference Proceedings (NSS/MIC), Sydney, NSW, Australia.10.1109/NSSMIC.2018.8824278 ↗
44. Pourasad, Y., and Cavallaro, F. (2021). A novel image processing approach to enhancement and compression of X-ray images. Int. J. Environ. Res. Public. Health, 18.10.3390/ijerph18136724 ↗
45. Image quality improvement for optical imaging interferometric microscopy10.1364/OE.444142 ↗
46. A computer-aided diagnosis system using artificial intelligence for the diagnosis and characterization of breast masses on ultrasound: Added value for the inexperienced breast radiologist10.1097/MD.0000000000014146 ↗
47. Computer-aided diagnosis in medical imaging: Historical review, current status and future potential10.1016/j.compmedimag.2007.02.002 ↗
48. Computerized Diagnostic Assistant for the Automatic Detection of Pneumothorax on Ultrasound: A Pilot Study10.5811/westjem.2016.1.28087 ↗
49. Computer-aided diagnosis in the era of deep learning10.1002/mp.13764 ↗
50. Furht, B., and Marqure, O. (2003). Objective video quality assessment. The Handbook of Video Databases: Design and Applications, CRC Press.10.1201/9780203489864 ↗
51. Lu, L., Wang, Z., Bovik, A.C., and Kouloheris, J. (2002, January 26–29). Full-reference video quality assessment considering structural distortion and no-reference quality evaluation of MPEG video. Proceedings of the IEEE International Conference on Multimedia and Expo, Lausanne, Switzerland.
52. Khan, M.H.-M., Boodoo-Jahangeer, N., Dullull, W., Nathire, S., Gao, X., Sinha, G.R., and Nagwanshi, K.K. (2021). Multi- class classification of breast cancer abnormalities using Deep Convolutional Neural Network (CNN). PLoS ONE, 16.10.1371/journal.pone.0256500 ↗
53. Breast tumor segmentation in ultrasound images using contextual-information-aware deep adversarial learning framework10.1016/j.eswa.2020.113870 ↗
54. Uddin, K.M.S. (2020). Ultrasound Guided Diffuse Optical Tomography for Breast Cancer Diagnosis: Algorithm Development. [Ph.D. Thesis, Washington University].
55. Mostavi, M., Chiu, Y.-C., Huang, Y., and Chen, Y. (2020). Convolutional neural network models for cancer type prediction based on gene expression. BMC Med. Genom., 13.10.1186/s12920-020-0677-2 ↗
56. Breast cancer classification using deep learning approaches and histopathology image: A comparison study10.1109/ACCESS.2020.3029881 ↗
57. Most apparent distortion: Full-reference image quality assessment and the role of strategy10.1117/1.3267105 ↗
58. Discrete shearlet transform based speckle noise removal in ultrasound images10.1007/s40009-018-0620-7 ↗
59. Ultrasound image despeckling using low rank matrix approximation approach10.1016/j.bspc.2017.06.011 ↗
60. Nagaraj, Y., Asha, C.S., and Narasimhadhan, A.V. (2016, January 22–25). Assessment of speckle denoising in ultrasound carotid images using least square Bayesian estimation approach. Proceedings of the 2016 IEEE Region 10 Conference (TENCON), Singapore.10.1109/TENCON.2016.7848156 ↗
61. Robust contour tracking in ultrasound tongue image sequences10.3109/02699206.2015.1110714 ↗
62. Diwakar, M., and Kumar, M. (2016, January 22–24). Edge preservation based CT image denoising using Wiener filtering and thresholding in wavelet domain. Proceedings of the 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC), Waknaghat, India.10.1109/PDGC.2016.7913171 ↗
63. Efficient low-dose CT denoising by locally-consistent non-local means (LC-NLM)
64. Sun, Y., Zhang, L., Li, Y., and Meng, J. (2019). A novel blind restoration and reconstruction approach for CT images based on sparse representation and hierarchical Bayesian-MAP. Algorithms, 12.10.3390/a12080174 ↗
65. Denoising and 3D reconstruction of CT images in extracted tooth via wavelet and bilateral filtering10.1142/S0218001418540101 ↗
66. Feature enhancement in medical ultrasound videos using contrast-limited adaptive histogram equalization10.1007/s10278-019-00211-5 ↗
67. Martinez-Girones, P.M., Vera-Olmos, J., Gil-Correa, M., Ramos, A., Garcia-Cañamaque, L., Izquierdo-Garcia, D., Malpica, N., and Torrado-Carvajal, A. (2021). Franken-CT: Head and neck MR-Based Pseudo-CT synthesis using diverse anatomical overlapping MR-CT scans. Appl. Sci., 11.10.3390/app11083508 ↗
68. Implementation of Sobel operator based image edge detection on FPGA10.1016/j.matpr.2020.10.825 ↗
69. A parametric texture model based on joint statistics of complex wavelet coefficients10.1023/A:1026553619983 ↗
70. A comprehensive assessment of the structural similarity index10.1007/s11760-009-0144-1 ↗
71. Mudeng, V., Kim, M., and Choe, S. (2021). Objective numerical evaluation of diffuse, optically reconstructed images using structural similarity index. Biosensors, 11.10.3390/bios11120504 ↗
72. Information content weighting for perceptual image quality assessment10.1109/TIP.2010.2092435 ↗
73. Zhou, F., Lu, Z., Wang, C., Sun, W., Xia, S.-T., and Liao, Q. (2015). Image quality assessment based on inter-patch and intra-patch similarity. PLoS ONE, 10.10.1371/journal.pone.0116312 ↗
74. SSIM-based joint-bit allocation for 3D video coding10.1007/s11042-017-5327-0 ↗
75. Zhang, H., Yuan, B., Dong, B., and Jiang, Z. (2018). No-reference blurred image quality assessment by structural similarity index. Appl. Sci., 8.10.3390/app8102003 ↗
76. Improved SSIM IQA of contrast distortion based on the contrast sensitivity characteristics of HVS10.1049/iet-ipr.2017.0209 ↗
77. Zhou, Y., Yu, M., Ma, H., Shao, H., and Jiang, G. (2018, January 12–16). Weighted-to-spherically-uniform ssim objective quality evaluation for panoramic video. Proceedings of the 2018 14th IEEE International Conference on Signal Processing (ICSP), Beijing, China.10.1109/ICSP.2018.8652269 ↗
78. Multi-exposure image fusion by optimizing a structural similarity index10.1109/TCI.2017.2786138 ↗
79. Cohort-based T-SSIM visual computing for radiation therapy prediction and exploration
80. Reviewing the research methods literature: Principles and strategies illustrated by a systematic overview of sampling in qualitative research10.1186/s13643-016-0343-0 ↗
81. Heath, M., Bowyer, K., Kopans, D., Moore, R., and Kegelmeyer, W.P. (2000, January 11–14). The digital database for screening mammography. Proceedings of the Fifth International Workshop on Digital Mammography, Toronto, ON, Canada.
82. Rajagopalan, S., and Robb, R. (2005, January 6). Phase-based image quality assessment. Proceedings of the SPIE 5749, Medical Imaging 2005: Image Perception, Observer Performance, and Technology Assessment, San Diego, CA, USA.10.1117/12.594655 ↗
83. Meinzer, H.-P., Handels, H., Horsch, A., and Tolxdorff, T. (2005). De-noising MRI Data—An iterative method for filter parameter optimization. Bildverarbeitung für die Medizin 2005, Springer.10.1007/b137570 ↗
84. Signal LMMSE estimation from multiple samples in MRI and DT-MRI
85. Kumar, B., Singh, S.P., Mohan, A., and Singh, H.V. (2009, January 15–17). MOS prediction of SPIHT medical images using objective quality parameters. Proceedings of the 2009 International Conference on Signal Processing Systems, Singapore.10.1109/ICSPS.2009.34 ↗
86. Xiao, Z.-S., and Zheng, C.-X. (2009, January 11–12). Medical image fusion based on the structure similarity match measure. Proceedings of the 2009 International Conference on Measuring Technology and Mechatronics Automation, Zhangjiajie, China.10.1109/ICMTMA.2009.558 ↗
87. Varghees, V.N., Manikandan, M.S., and Gini, R. (2012, January 30–31). Adaptive MRI image denoising using total-variation and local noise estimation. Proceedings of the IEEE International Conference on Advances in Engineering, Science and Management (ICAESM-2012), Nagapattinam, India.
88. Restoration algorithm for gaussian corrupted MRI using non-local averaging10.1007/978-81-322-2247-7_84 ↗
89. Srivastava, A., Bhateja, V., and Tiwari, H. (2015, January 11–13). Modified anisotropic diffusion filtering algorithm for MRI. Proceedings of the 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India.
90. Chandrashekar, L., and Sreedevi, A. (2017, January 22–24). Assessment of non-linear filters for MRI images. Proceedings of the 2017 Second International Conference on Electrical, Computer and Communication Technologies (ICECCT), Coimbatore, India.10.1109/ICECCT.2017.8117852 ↗
91. Biomedical image compression using fuzzy transform and deterministic binary compressive sensing matrix10.1007/s12652-020-02103-x ↗
92. Liver segmentation in MRI images based on whale optimization algorithm10.1007/s11042-017-4638-5 ↗
93. Pawar, K., Chen, Z., Shah, N.J., and Egan, G.F. (2019). Suppressing motion artefacts in MRI using an Inception-ResNet network with motion simulation augmentation. NMR Biomed., e4225.10.1002/nbm.4225 ↗
94. Wang, J., Chen, Y., Wu, Y., Shi, J., and Gee, J. (2020, January 1–5). Enhanced generative adversarial network for 3D brain MRI super-resolution. Proceedings of the 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass Village, CO, USA.10.1109/WACV45572.2020.9093603 ↗
95. Evaluation of the 3D fractal dimension as a marker of structural brain complexity in multiple-acquisition MRI10.1002/hbm.24599 ↗
96. Senthilkumar, S., and Muttan, S. (2007, January 13–15). Effective multiresolute computation to remote sensed data fusion. Proceedings of the International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007), Sivakasi, India.10.1109/ICCIMA.2007.57 ↗
97. Optimization of block size for DCT-based medical image compression10.1080/03091900500421255 ↗
98. Mahmoud, A., Taher, F., and Al-Ahmad, H. (2016, January 28–30). Two dimensional filters for enhancing the resolution of interpolated CT scan images. Proceedings of the 2016 12th International Conference on Innovations in Information Technology (IIT), Al-Ain, United Arab Emirates.10.1109/INNOVATIONS.2016.7880034 ↗
99. Medical image fusion in curvelet domain employing PCA and maximum selection rule
100. Assessment of structural similarity in CT using filtered backprojection and iterative reconstruction: A phantom study with 3D printed lung vessels10.1259/bjr.20160519 ↗