journal article·2024-09-06Open access

Incorporation of Structural Similarity Index and Regularization Term into Neighbor2Neighbor Unsupervised Learning Model for Efficient Ultrasound Image Data Denoising

Peiyang Wei, Liping Wang, Jianhong Gan, Xiaoyu Shi, Mingsheng Shang

Applied Sciences· Volume 14· Issue 17

Abstract

Medical ultrasound imaging is extensively employed for diagnostic purposes. However, image quality remains a major obstacle to achieving greater accuracy. Conventional supervised deep learning denoising methods often rely on matched noise-free and noisy image pairs, which can be highly challenging in practical ultrasound applications. Moreover, due to the limitations associated with independent noise, existing unsupervised denoising methods such as Neighbor2Neighbor are unable to efficiently address correlated noise in ultrasound images. Meanwhile, these methods utilize a random neighborhood downsampling technique, frequently resulting in pixel loss. Hence, this study proposes a novel Neighbor2Neighbor algorithm, which reconstructs ultrasound images by improving the downsampling approach. Moreover, it incorporates a structural similarity index and a regularization term, thereby enhancing its ability to suppress both independent and correlated noise. Extensive experiments on an ultrasound image dataset demonstrate that the proposed Neighbor2Neighbor algorithm outperforms the state-of-the-art baseline algorithms in peak signal-to-noise ratio (PSNR), mean structural similarity index measure (MSSIM), feature similarity index measure (FSIM), and edge preservation index (EPI).
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image and Signal Denoising Methods · Advanced Image Fusion Techniques · Advanced Image Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China

School of Software Engineering, Chengdu University of Information Technology, Chengdu 610225, China

Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China

Automatic Software Generation & Intelligence Service Key Laboratory of Sichuan Province, Chengdu 610225, China

School of Intelligent Science and Engineering, Chengdu Neusoft University, Chengdu 611844, China

Funding

Sichuan University Students’ Innovation and Entrepreneurship Training Program · Chengdu University of Information Technology Key Project of Education Reform

References (27)

Show source-provided references
1. Enhanced Wiener filter for ultrasound image restoration10.1016/j.cmpb.2017.10.006 ↗
2. Influence of tessellation morphology on ultrasonic scattering10.1121/10.0014288 ↗
3. Azar, A.A., Rivaz, H., and Boctor, E.M. (2012). Speckle Detection in Echocardiographic Images. Echocardiography-New Techniques, IntechOpen.
4. Single image composite tomography utilizing large scale femtosecond laser cross-sectioning and scanning electron microscopy10.1017/S1431927622003889 ↗
5. Artificial intelligence-based bone-enhanced magnetic resonance image—A computed tomography/magnetic resonance image composite image modality in nasopharyngeal carcinoma radiotherapy10.21037/qims-20-1239 ↗
6. Cardiovascular risk assessment in patients with rheumatoid arthritis using carotid ultrasound B-mode imaging10.1007/s00296-020-04691-5 ↗
7. An optimized non-local means filter using automated clustering based preclassification through gap statistics for speckle reduction in breast ultrasound images10.1016/j.aci.2017.01.002 ↗
8. Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising10.1109/TIP.2017.2662206 ↗
9. FFDNet: Toward a fast and flexible solution for CNN-based image denoising10.1109/TIP.2018.2839891 ↗
10. Lehtinen, J., Munkberg, J., Hasselgren, J., Laine, S., Karras, T., Aittala, M., and Aila, T. (2018). Noise2Noise: Learning image restoration without clean data. arXiv.
11. Krull, A., Buchholz, T.O., and Jug, F. (2019, January 15–20). Noise2void-learning denoising from single noisy images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00223 ↗
12. Batson, J., and Royer, L. (2019, January 15–20). Noise2self: Blind denoising by self-supervision. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
13. Krull, A., Vičar, T., Prakash, M., Lalit, M., and Jug, F. (2020). Probabilistic noise2void: Unsupervised content-aware denoising. Front. Comput. Sci., 2.10.3389/fcomp.2020.00005 ↗
14. Wu, X., Liu, M., Cao, Y., Ren, D., and Zuo, W. (2020, January 23–28). Unpaired Learning of Deep Image Denoising. Proceedings of the Computer Vision—ECCV 2020, Glasgow, UK. LNCS 12349.10.1007/978-3-030-58548-8_21 ↗
15. Huang, T., Li, S., Jia, X., Lu, H., and Liu, J. (2021, January 20–25). Neighbor2neighbor: Self-supervised denoising from single noisy images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01454 ↗
16. Self-supervised PET image denoising using a neighbor-to-neighbor network
17. Adaptive speckle reduction filter for log-compressed B-scan images10.1109/42.544498 ↗
18. Despeckling of medical ultrasound images10.1109/TUFFC.2006.1588392 ↗
19. Speckle reducing anisotropic diffusion10.1109/TIP.2002.804276 ↗
20. Loupas, T. (1988). Digital Image Processing for Noise Reduction in Medical Ultrasonics. [Ph.D. Thesis, University of Edinburgh].
21. An adaptive weighted median filter for speckle suppression in medical ultrasonic images10.1109/31.16577 ↗
22. SSIM compliant modeling framework with denoising and deblurring applications10.1109/TIP.2021.3053369 ↗
23. 2Pa5-1 Image Quality Assessment of 3D Ultrasound Images Based on SSIM
24. FSIM: A feature similarity index for image quality assessment10.1109/TIP.2011.2109730 ↗
25. Sun, Y., Xin, Z., Huang, X., Wang, Z., and Xuan, J. (2021). Overview of SAR Image Denoising Based on Transform Domain. 3D Imaging Technologies—Multi-Dimensional Signal Processing and Deep Learning, Springer. Smart Innovation, Systems and Technologies.10.1007/978-981-16-3391-1_5 ↗
26. Image denoising by sparse 3-D transform-domain collaborative filtering10.1109/TIP.2007.901238 ↗
27. Dataset of breast ultrasound images10.1016/j.dib.2019.104863 ↗