journal article·2023-12-03Open access

A Multiscale Deep Encoder–Decoder with Phase Congruency Algorithm Based on Deep Learning for Improving Diagnostic Ultrasound Image Quality

Ryeonhui Kim, Kyuseok Kim, Youngjin Lee

Applied Sciences· Volume 13· Issue 23

Abstract

Ultrasound imaging is widely used as a noninvasive lesion detection method in diagnostic medicine. Improving the quality of these ultrasound images is very important for accurate diagnosis, and deep learning-based algorithms have gained significant attention. This study proposes a multiscale deep encoder–decoder with phase congruency (MSDEPC) algorithm based on deep learning to improve the quality of diagnostic ultrasound images. The MSDEPC algorithm included low-resolution (LR) images and edges as inputs and constructed a multiscale convolution and deconvolution network. Simulations were conducted using the Field 2 program, and data from real experimental research were obtained using five clinical datasets containing images of the carotid artery, liver hemangiomas, breast malignancy, thyroid carcinomas, and obstetric nuchal translucency. LR images, bicubic interpolation, and super-resolution convolutional neural networks (SRCNNs) were modeled as comparison groups. Through visual assessment, the image processed using the MSDEPC was the clearest, and the lesions were clearly distinguished. The structural similarity index metric (SSIM) value of the simulated ultrasound image using the MSDEPC algorithm improved by approximately 38.84% compared to LR. In addition, the peak signal-to-noise ratio (PSNR) and SSIM values of clinical ultrasound images using the MSDEPC algorithm improved by approximately 2.33 times and 88.58%, respectively, compared to LR. In conclusion, the MSDEPC algorithm is expected to significantly improve the spatial resolution of ultrasound images.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image and Signal Denoising Methods · Advanced Image Processing Techniques · AI in cancer detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Radiology, Sunchonhyang University Bucheon Hospital, 170, Jomaru-ro, Bucheon-si 14584, Gyeonggi-do, Republic of Korea

Department of Health Science, General Graduate School of Gachon University, 191, Hambakmoero, Yeonsu-gu, Incheon 21936, Republic of Korea

Department of Biomedical Engineering, Eulji University, 553, Sanseong-daero, Sujeong-gu, Seongnam-si 13135, Gyeonggi-do, Republic of Korea

Department of Radiological Science, Gachon University, 191, Hambakmoero, Yeonsu-gu, Incheon 21936, Republic of Korea

Funding

National Foundation of Korea

References (55)

Show source-provided references
1. Application of Ultrasound in Medicine10.5455/aim.2011.19.168-171 ↗
2. Efficacy of intraoperative wireless ultrasonography for uterine incision among patients with adherence findings in placenta previa10.1111/jog.14243 ↗
3. Classification of Liver Fibrosis from Heterogeneous Ultrasound Image10.1109/ACCESS.2023.3240216 ↗
4. The Emerging Crisis of Stakeholders in Implant-based Augmentation Mammaplasty in Korea10.3346/jkms.2020.35.e103 ↗
5. Investigation of optimal convolutional neural network conditions for thyroid ultrasound image analysis10.1038/s41598-023-28001-8 ↗
6. Yu, S.H., Hwang, J.H., Kim, J.H., Park, S., Lee, K.H., and Choi, S.T. (2020). Duplication of superficial femoral artery: Imaging findings and literature review. BMC Med. Imaging, 20.10.1186/s12880-020-00500-4 ↗
7. Resolution in ultrasound imaging10.1093/bjaceaccp/mkr030 ↗
8. Image Optimization in Venous Ultrasound Examination10.37923/phle.2022.20.2.64 ↗
9. Super-resolution image reconstruction: A technical overview10.1109/MSP.2003.1203207 ↗
10. Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images10.1109/83.650118 ↗
11. Improvement of signal and noise performance using single image super-resolution based on deep learning in single photon-emission computed tomography imaging system10.1016/j.net.2021.01.011 ↗
12. Fast and robust multiframe super resolution10.1109/TIP.2004.834669 ↗
13. Fundamental limits of reconstruction-based super-resolution algorithms under local translation10.1109/TPAMI.2004.1261081 ↗
14. Example-based super-resolution10.1109/38.988747 ↗
15. Stochastic relaxation, gibbs distributions, and the Bayesian restoration of images10.1109/TPAMI.1984.4767596 ↗
16. Sun, J., Xu, Z., and Shum, H.-Y. (2008, January 24–26). Image super-resolution using gradient profile prior. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition 2008, Anchorage, AK, USA.
17. Coupled dictionary training for image super-resolution10.1109/TIP.2012.2192127 ↗
18. Yang, J., Lin, Z., and Cohen, S. (2013, January 23–28). Fast image super-resolution based on in-place example regression. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition 2013, Portland, OR, USA.10.1109/CVPR.2013.141 ↗
19. Deep learning for single image super-resolution: A brief review10.1109/TMM.2019.2919431 ↗
20. Survey of single image super-resolution reconstruction10.1049/iet-ipr.2019.1438 ↗
21. Image super-resolution using deep convolutional networks10.1109/TPAMI.2015.2439281 ↗
22. Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27–30). Accurate image super-resolution using very deep convolutional networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.182 ↗
23. Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21–26). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.19 ↗
24. A deep journey into super-resolution: A survey10.1145/3390462 ↗
25. Single image super-resolution using multi-scale deep encoder-decoder with phase congruency edge map guidance10.1016/j.ins.2018.09.018 ↗
26. Perception consistency ultrasound image super-resolution via self-supervised CycleGAN10.1007/s00521-020-05687-9 ↗
27. Yu, L., Zhang, X., and Chu, Y. (2020). Super-resolution reconstruction algorithm for infrared image with double regular items based on sub-pixel convolution. Appl. Sci., 10.10.3390/app10031109 ↗
28. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
29. Kesarwani, A., Purohit, K., Dalui, M., and Kisku, D.R. (2020, January 7–9). Measuring the degree of suitability of edge detection operators prior to an application. Proceedings of the 2020 IEEE Applied Signal Processing Conference (ASPCON), Kolkata, India.10.1109/ASPCON49795.2020.9276678 ↗
30. Image features from phase congruency
31. Forero, M.G., and Jacanamejoy, C.A. (2021). Unified mathematical formulation of monogenic phase congruency. Mathematics, 9.10.3390/math9233080 ↗
32. Feature detection from local energy10.1016/0167-8655(87)90013-4 ↗
33. Multi-spectral palmprint recognition based on oriented multiscale log-gabor filters10.1016/j.neucom.2016.05.005 ↗
34. Xie, S., and Tu, Z. (2015, January 7–13). Holistically-nested edge detection. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.164 ↗
35. Shen, W., Zhao, K., Jiang, Y., Wang, Y., Zhang, Z., and Bai, X. (2015, January 7–13). Object skeleton extraction in natural images by fusing scale-associated deep side outputs. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Las Vegas, NV, USA.10.1109/CVPR.2016.31 ↗
36. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the 32nd International Conference on International Conference on Machine Learning (ICML’15), Lille, France.
37. He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7–13). Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.123 ↗
38. Kingma, D.P., and Ba, J. (2015). Adam: A method for stochastic optimization. arXiv.
39. Generation of acoustic pulses by baffled plane pistons10.1112/S0025579300008184 ↗
40. Computer Phantoms for Simulating Ultrasound B-Mode and CFM Images10.1007/978-1-4419-8588-0_12 ↗
41. Cubic convolution interpolation for digital image processing10.1109/TASSP.1981.1163711 ↗
42. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified linear units improve restricted Boltzmann machines. Proceedings of the 27th International Conference on International Conference on Machine Learning (ICML’10), Haifa, Israel.
43. Focal Liver Lesion Detection in Ultrasound Image Using Deep Feature Fusions and Super Resolution10.3390/make2030010 ↗
44. Sparing of Fatty Infiltration Around Focal Hepatic Lesions in Patients with Hepatic Steatosis: Sonographic Appearance with CT and MRI Correlation10.2214/AJR.07.2863 ↗
45. Role of high resolution ultrasound complementary to digital mammography10.4103/aam.aam_36_17 ↗
46. Ultrasound super-resolution imaging for differential diagnosis of breast masses10.3389/fonc.2022.1049991 ↗
47. ThyroScreen system: High resolution ultrasound thyroid image characterization into benign and malignant classes using novel combination of texture and discrete wavelet transform10.1016/j.cmpb.2011.10.001 ↗
48. The Associations of Nuchal Translucency and Fetal Abnormalities; Significance and Implications
49. Bulat, A.B., and Tzimiropoulos, G. (2018, January 8–14). To learn image super-resolution, use a GAN to learn how to do image degradation first. Proceedings of the ECCV 2018: Computer Vision–ECCV, Munich, Germany.10.1007/978-3-030-01231-1_12 ↗
50. Liu, J., Tang, J., and Wu, G. (2021). AdaDM: Enabling normalization for image super-resolution. arXiv.
51. Image super-resolution: A comprehensive review, recent trends, challenges and applications10.1016/j.inffus.2022.10.007 ↗
52. Remote sensing image registration based on phase congruency feature detection and spatial constraint matching10.1109/ACCESS.2018.2883410 ↗
53. Fast feature-preserving speckle reduction for ultrasound images via phase congruency10.1016/j.sigpro.2016.12.011 ↗
54. Direct sound printing10.1038/s41467-022-29395-1 ↗
55. Near-field clutter artifact reduction algorithm based on wavelet thresholding method in echocardiography using 3D printed cardiac phantom10.1007/s40042-022-00512-z ↗