journal article·2025-03-14Open access

Dual-Branch CNN–Mamba Method for Image Defocus Deblurring

Wenqi Zhao, Chunlei Wu, Jing Lu, Ran Li

Applied Sciences· Volume 15· Issue 6

Abstract

Defocus deblurring is a challenging task in the fields of computer vision and image processing. The irregularity of defocus blur kernels, coupled with the limitations of computational resources, poses significant difficulties for defocused image restoration. Additionally, the varying degrees of blur across different regions of the image impose higher demands on feature capture. Insufficient fine-grained feature extraction can result in artifacts and the loss of details, while inadequate coarse-grained feature extraction can cause image distortion and unnatural transitions. To address these challenges, we propose a defocus image deblurring method based on a hybrid CNN–Mamba architecture. This approach employs a data-driven, network-based self-learning strategy for blur processing, eliminating the need for traditional blur kernel estimation. Furthermore, by designing parallel feature extraction modules, the method leverages the local feature extraction capabilities of CNNs to capture image details, effectively restoring texture and edge information. The Mamba module models long-range dependencies, ensuring global consistency in the image. On the real defocus blur dual-pixel image dataset DPDD, the proposed CMDDNet achieves a PSNR of 28.37 in the Indoor dataset, surpassing Uformer-B (28.23) while significantly reducing the parameter count to only 9.74 M, which is 80.9% less than Uformer-B (50.88 M). Although the PSNR on the Outdoor and Combined datasets is slightly lower, CMDDNet maintains competitive performance with a significantly reduced model size, demonstrating its efficiency and effectiveness in defocus deblurring. These results indicate that CMDDNet offers a promising trade-off between performance and computational efficiency, making it well suited for lightweight applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image Processing Techniques · Image Processing Techniques and Applications · Image and Signal Denoising Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Shandong Key Laboratory of Intelligent Oil & Gas Industrial Software, Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, China

Funding

Natural Science Foundation of Shandong Province · Qingdao Natural Science Foundation

References (36)

Show source-provided references
1. Chan, S.H., and Nguyen, T.Q. (2011, January 11–14). Single image spatially variant out-of-focus blur removal. Proceedings of the 2011 18th IEEE International Conference on Image Processing, Brussels, Belgium.10.1109/ICIP.2011.6116643 ↗
2. Single-image blind deblurring using multi-scale latent structure prior
3. Do, T.D., Cui, X., Nguyen, T.H.B., Nguyen, V.H., and Kim, H. (2018, January 5–6). Blind deconvolution method using omnidirectional gabor filter-based edge information. Proceedings of the 2018 1st International Conference on Multimedia Analysis and Pattern Recognition (MAPR), Ho Chi Minh City, Vietnam.10.1109/MAPR.2018.8337513 ↗
4. Lee, J., Lee, S., Cho, S., and Lee, S. (2019, January 15–20). Deep defocus map estimation using domain adaptation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01250 ↗
5. Yang, H., Zhu, M., Zhang, Z., and Huang, H. (2016). Guided filter based edge-preserving image non-blind deconvolution. arXiv.
6. Anger, J., Facciolo, G., and Delbracio, M. (2018, January 7–10). Modeling realistic degradations in non-blind deconvolution. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.10.1109/ICIP.2018.8451115 ↗
7. Son, H., Lee, J., Cho, S., and Lee, S. (2021, January 10–17). Single image defocus deblurring using kernel-sharing parallel atrous convolutions. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00264 ↗
8. Gaussian kernel mixture network for single image defocus deblurring
9. Abuolaim, A., and Brown, M.S. (2020). Defocus deblurring using dual-pixel data. Lecture Notes in Computer Science, Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, 23–28 August 2020, Proceedings, Part X 16, Springer.
10. Lee, J., Son, H., Rim, J., Cho, S., and Lee, S. (2021, January 20–25). Iterative filter adaptive network for single image defocus deblurring. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00207 ↗
11. Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., and Li, H. (2022, January 18–24). Uformer: A general u-shaped transformer for image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01716 ↗
12. Vaswani, A. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30.
13. Gu, A., and Dao, T. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv.
14. Graph-based blind image deblurring from a single photograph10.1109/TIP.2018.2874290 ↗
15. Edge-based defocus blur estimation with adaptive scale selection10.1109/TIP.2017.2771563 ↗
16. Shi, J., Xu, L., and Jia, J. (2015, January 7–12). Just noticeable defocus blur detection and estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298665 ↗
17. Abuolaim, A., Afifi, M., and Brown, M.S. (2022, January 3–8). Improving single-image defocus deblurring: How dual-pixel images help through multi-task learning. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV51458.2022.00016 ↗
18. LR-net: A block-based convolutional neural network for low-resolution image classification10.1007/s40998-023-00618-5 ↗
19. Mahdavi, F., and Rajabi, R. (2020, January 23–24). Drone detection using convolutional neural networks. Proceedings of the 2020 6th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), Mashhad, Iran.10.1109/ICSPIS51611.2020.9349620 ↗
20. Ma, T., Dalca, A.V., and Sabuncu, M.R. (2022, January 3–8). Hyper-convolution networks for biomedical image segmentation. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV51458.2022.00205 ↗
21. Closed-loop feedback network with cross back-projection for lightweight image super-resolution10.1007/s11265-022-01764-5 ↗
22. Visual tracking based on depth cross-correlation and feature alignment10.1007/s11265-022-01791-2 ↗
23. Sun, J., Cao, W., Xu, Z., and Ponce, J. (2015, January 7–12). Learning a convolutional neural network for non-uniform motion blur removal. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298677 ↗
24. Li, Y., Yi, Y., Ren, D., Li, Q., and Zuo, W. (2022). Learning dual-pixel alignment for defocus deblurring. arXiv.
25. Li, S., Singh, H., and Grover, A. (2025, January 26–27). Mamba-nd: Selective state space modeling for multi-dimensional data. Proceedings of the European Conference on Computer Vision, Paris, France.10.1007/978-3-031-73414-4_5 ↗
26. Ruan, J., and Xiang, S. (2024). Vm-unet: Vision mamba unet for medical image segmentation. arXiv.
27. CM-Unet: A novel remote sensing image segmentation method based on improved U-Net10.1109/ACCESS.2023.3282778 ↗
28. Lu, Y., Wang, S., Wang, Z., Xia, P., and Zhou, T. (2024). LFMamba: Light Field Image Super-Resolution with State Space Model. arXiv.
29. Zhou, Q., Yang, W., Fei, B., Xu, J., Zhang, R., Liu, K., Luo, Y., and He, Y. (2024). 3dmambaipf: A state space model for iterative point cloud filtering via differentiable rendering. arXiv.
30. Fu, D.Y., Dao, T., Saab, K.K., Thomas, A.W., Rudra, A., and Ré, C. (2022). Hungry hungry hippos: Towards language modeling with state space models. arXiv.
31. Gu, A., Goel, K., and Ré, C. (2021). Efficiently modeling long sequences with structured state spaces. arXiv.
32. Alexey, D. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
33. Zhu, L., Liao, B., Zhang, Q., Wang, X., Liu, W., and Wang, X. (2024). Vision mamba: Efficient visual representation learning with bidirectional state space model. arXiv.
34. Liu, Y., Tian, Y., Zhao, Y., Yu, H., Xie, L., Wang, Y., Ye, Q., and Liu, Y. (2024). VMamba: Visual State Space Model. arXiv.
35. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
36. Abuolaim, A., Delbracio, M., Kelly, D., Brown, M.S., and Milanfar, P. (2021, January 11–17). Learning to reduce defocus blur by realistically modeling dual-pixel data. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00229 ↗