One-Step Enhancer: Deblurring and Denoising of OCT Images
Source abstract
Abstract
Optical coherence tomography (OCT) is a rapidly evolving imaging technology that combines a broadband and low-coherence light source with interferometry and signal processing to produce high-resolution images of living tissues. However, the speckle noise introduced by the low-coherence interferometry and the blur from device motions significantly degrade the quality of OCT images. Convolutional neural networks (CNNs) are a potential solution to deal with these issues and enhance OCT image quality. However, training such networks based on traditional supervised learning methods is impractical due to the lack of clean ground truth images. Consequently, this research proposes an unsupervised learning method for OCT image enhancement, termed one-step enhancer (OSE). Specifically, OSE performs denoising and deblurring based on a single step process. A generative adversarial network (GAN) is used for this. Encoders disentangle the raw images into a content domain, blur domain and noise domain to extract features. Then, the generator can generate clean images from the extracted features. To regularize the distribution range of retrieved blur characteristics, KL divergence loss is employed. Meanwhile, noise patches are enforced to promote more accurate disentanglement. These strategies considerably increase the effectiveness of GAN training for OCT image enhancement when used jointly. Both quantitative and qualitative visual findings demonstrate that the proposed method is effective for OCT image denoising and deblurring. These results are significant not only to provide an enhanced visual experience for clinicians but also to supply good quality data for OCT-guide operations. The enhanced images are needed, e.g., for the development of robust, reliable and accurate autonomous OCT-guided surgical robotic systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Optical Coherence Tomography Applications · Advanced Image Processing Techniques · Image and Signal Denoising Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Advanced Robotics, Istituto Italiano di Tecnologia, 16163 Genoa, Italy
Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, 16145 Genoa, Italy
References (26)
Show source-provided references
1. Optical coherence tomography10.1111/j.1365-2818.2012.03619.x ↗
2. Ultrahigh-resolution ophthalmic optical coherence tomography10.1038/86589 ↗
3. Optical clearing for OCT image enhancement and in-depth monitoring of molecular diffusion10.1109/JSTQE.2011.2181991 ↗
4. Speckle reduction in optical coherence tomography images of human finger skin by wavelet modified BM3D filter10.1016/j.optcom.2012.10.053 ↗
5. Nonlocal transform-domain filter for volumetric data denoising and reconstruction10.1109/TIP.2012.2210725 ↗
6. Optical coherence tomography technology and quality improvement methods for optical coherence tomography images of skin: A short review10.1177/1179597217713475 ↗
7. Statistical model for OCT image denoising10.1364/BOE.8.003903 ↗
8. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising10.1109/TIP.2017.2662206 ↗
9. Real-time OCT image denoising using a self-fusion neural network10.1364/BOE.451029 ↗
10. Guo, Y., Wang, K., Yang, S., Wang, Y., Gao, P., Xie, G., Lv, C., and Lv, B. (2019, January 17). Structure-aware noise reduction generative adversarial network for optical coherence tomography image. Proceedings of the International Workshop on Ophthalmic Medical Image Analysis, Shenzhen, China.10.1007/978-3-030-32956-3_2 ↗
11. Retinal fundus image superresolution generated by optical coherence tomography based on a realistic mixed attention GAN10.1002/mp.15580 ↗
12. Manakov, I., Rohm, M., Kern, C., Schworm, B., Kortuem, K., and Tresp, V. (2019, January 17). Noise as domain shift: Denoising medical images by unpaired image translation. Proceedings of the Domain Adaptation and Representation Transfer and Medical Image Learning with Less Labels and Imperfect Data, International Workshop on Medical Image Learning with Less Labels and Imperfect Data, Shenzhen, China.10.1007/978-3-030-33391-1_1 ↗
13. SiameseGAN: A generative model for denoising of spectral domain optical coherence tomography images10.1109/TMI.2020.3024097 ↗
14. Zhu, J.Y., Zhang, R., Pathak, D., Darrell, T., Efros, A.A., Wang, O., and Shechtman, E. (2017, January 4–9). Toward multimodal image-to-image translation. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
15. Lee, H.Y., Tseng, H.Y., Huang, J.B., Singh, M., and Yang, M.H. (2018, January 8–14). Diverse image-to-image translation via disentangled representations. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01246-5_3 ↗
16. Noise-powered disentangled representation for unsupervised speckle reduction of optical coherence tomography images10.1109/TMI.2020.3045207 ↗
17. Hershey, J.R., and Olsen, P.A. (2007, January 15–20). Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models. Proceedings of the 2007 IEEE International Conference on Acoustics, Speech and Signal Processing—ICASSP’07, Honolulu, HI, USA.10.1109/ICASSP.2007.366913 ↗
18. Unsupervised super-resolution of OCT images using generative adversarial network for improved age-related macular degeneration diagnosis10.1109/JSEN.2020.2985131 ↗
19. Unsupervised denoising of optical coherence tomography images with nonlocal-generative adversarial network10.1109/TIM.2020.2987636 ↗
20. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
21. Lu, B., Chen, J.C., and Chellappa, R. (2019, January 15–20). Unsupervised domain-specific deblurring via disentangled representations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01047 ↗
22. Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
23. Park, T., Liu, M.Y., Wang, T.C., and Zhu, J.Y. (2019, January 15–20). Semantic image synthesis with spatially-adaptive normalization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00244 ↗
24. Karras, T., Laine, S., and Aila, T. (2019, January 15–20). A style-based generator architecture for generative adversarial networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00453 ↗
25. Collaborative filtering of correlated noise: Exact transform-domain variance for improved shrinkage and patch matching10.1109/TIP.2020.3014721 ↗
26. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗