journal article·2020-01-31Open access

Blind Deconvolution with Scale Ambiguity

Wanshu Fan, Hongyan Wang, Yan Wang, Zhixun Su

Applied Sciences· Volume 10· Issue 3

Abstract

Recent years have witnessed significant advances in single image deblurring due to the increasing popularity of electronic imaging equipment. Most existing blind image deblurring algorithms focus on designing distinctive image priors for blur kernel estimation, which usually play regularization roles in deconvolution formulation. However, little research effort has been devoted to the relative scale ambiguity between the latent image and the blur kernel. The well-known L 1 normalization constraint, i.e., fixing the sum of all the kernel weights to be one, is commonly selected to remove this ambiguity. In contrast to this arbitrary choice, we in this paper introduce the L p -norm normalization constraint on the blur kernel associated with a hyper-Laplacian prior. We show that the employed hyper-Laplacian regularizer can be transformed into a joint regularized prior based on a scale factor. We quantitatively show that the proper choice of p makes the joint prior sufficient to favor the sharp solutions over the trivial solutions (the blurred input and the delta kernel). This facilitates the kernel estimation within the conventional maximum a posterior (MAP) framework. We carry out numerical experiments on several synthesized datasets and find that the proposed method with p = 2 generates the highest average kernel similarity, the highest average PSNR and the lowest average error ratio. Based on these numerical results, we set p = 2 in our experiments. The evaluation on some real blurred images demonstrate that the results by the proposed methods are visually better than the state-of-the-art deblurring methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image Processing Techniques · Image Processing Techniques and Applications · Image and Signal Denoising Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mathematical Sciences, Dalian University of Technology, Dalian 116024, China

Funding

National Natural Science Foundation of China

References (44)

Show source-provided references
1. Xu, L., and Jia, J. (2010). Two-Phase Kernel Estimation for Robust Motion Deblurring. ECCV, 157–170.10.1007/978-3-642-15549-9_12 ↗
2. A Logarithmic Image Prior for Blind Deconvolution10.1007/s11263-015-0857-2 ↗
3. Image Deblurring via Enhanced Low Rank Prior10.1109/TIP.2016.2571062 ↗
4. Pan, J., Dong, J., Tai, Y., Su, Z., and Yang, M. (2017). Learning Discriminative Data Fitting Functions for Blind Image Deblurring. ICCV, 1077–1085.10.1109/ICCV.2017.122 ↗
5. Deblurring Images via Dark Channel Prior10.1109/TPAMI.2017.2753804 ↗
6. Learning to Deblur Images with Exemplars10.1109/TPAMI.2018.2832125 ↗
7. Single image fast deblurring algorithm based on hyper-Laplacian model10.1049/iet-ipr.2018.5890 ↗
8. Lai, W., Huang, J., Hu, Z., Ahuja, N., and Yang, M. (2016). A Comparative Study for Single Image Blind Deblurring. CVPR, 1701–1709.10.1109/CVPR.2016.188 ↗
9. Fast motion deblurring10.1145/1618452.1618491 ↗
10. Krishnan, D., Tay, T., and Fergus, R. (2011). Blind deconvolution using a normalized sparsity measure. CVPR, 233–240.10.1109/CVPR.2011.5995521 ↗
11. Levin, A., Weiss, Y., Durand, F., and Freeman, W.T. (2011). Efficient marginal likelihood optimization in blind deconvolution. CVPR, 2657–2664.10.1109/CVPR.2011.5995308 ↗
12. Xu, L., Zheng, S., and Jia, J. (2013). Unnatural L0 Sparse Representation for Natural Image Deblurring. CVPR, 1107–1114.10.1109/CVPR.2013.147 ↗
13. Michaeli, T., and Irani, M. (2014). Blind Deblurring Using Internal Patch Recurrence. ECCV, 783–798.10.1007/978-3-319-10578-9_51 ↗
14. Perrone, D., and Favaro, P. (2014). Total Variation Blind Deconvolution: The Devil Is in the Details. CVPR, 2909–2916.10.1109/CVPR.2014.372 ↗
15. L0-Regularized Intensity and Gradient Prior for Deblurring Text Images and Beyond10.1109/TPAMI.2016.2551244 ↗
16. Yan, Y., Ren, W., Guo, Y., Wang, R., and Cao, X. (2017). Image Deblurring via Extreme Channels Prior. CVPR, 6978–6986.10.1109/CVPR.2017.738 ↗
17. Jin, M., Roth, S., and Favaro, P. (2018). Normalized Blind Deconvolution. ECCV, 694–711.10.1007/978-3-030-01234-2_41 ↗
18. Patch-Wise Blind Image Deblurring Via Michelson Channel Prior10.1109/ACCESS.2019.2959800 ↗
19. Levin, A., Weiss, Y., Durand, F., and Freeman, W.T. (2009). Understanding and evaluating blind deconvolution algorithms. CVPR, 1964–1971.10.1109/CVPRW.2009.5206815 ↗
20. High-quality motion deblurring from a single image10.1145/1360612.1360672 ↗
21. Zhang, Y., Lau, Y., Kuo, H., Cheung, S., Pasupathy, A., and Wright, J. (2017). On the Global Geometry of Sphere-Constrained Sparse Blind Deconvolution. CVPR, 4381–4389.10.1109/CVPR.2017.466 ↗
22. On Advances in Statistical Modeling of Natural Images10.1023/A:1021889010444 ↗
23. Blur kernel estimation via salient edges and low rank prior for blind image deblurring10.1016/j.image.2017.07.004 ↗
24. Dong, J., Pan, J., Sun, D., Su, Z., and Yang, M. (2018). Learning Data Terms for Non-blind Deblurring. ECCV, 777–792.10.1007/978-3-030-01252-6_46 ↗
25. Text image deblurring via two-tone prior10.1016/j.neucom.2017.01.080 ↗
26. Blind deblurring with sparse representation via external patch priors10.1016/j.dsp.2018.03.017 ↗
27. Li, L., Pan, J., Lai, W., Gao, C., Sang, N., and Yang, M.H. (2019). Blind Image Deblurring via Deep Discriminative Priors. Int. J. Comput. Vis., 1–19.10.1007/s11263-018-01146-0 ↗
28. Chen, L., Fang, F., Wang, T., and Zhang, G. (2019). Blind Image Deblurring With Local Maximum Gradient Prior. CVPR, 1742–1750.10.1109/CVPR.2019.00184 ↗
29. Sun, L., Cho, S., Wang, J., and Hays, J. (2013). Edge-based blur kernel estimation using patch priors. ICCP, 1–8.
30. A Hybrid Motion Deblurring Strategy Using Patch Based Edge Restoration and Bilateral Filter10.1007/s10851-018-0797-x ↗
31. Chakrabarti, A. (2016). A Neural Approach to Blind Motion Deblurring. ECCV, 221–235.10.1007/978-3-319-46487-9_14 ↗
32. Boosting normalized sparsity regularization for blind image deconvolution10.1007/s11760-016-1010-6 ↗
33. Blind motion image deblurring using an effective blur kernel prior10.1007/s11042-019-7402-1 ↗
34. Nah, S., Kim, T.H., and Lee, K.M. (2017). Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring. CVPR, 257–265.10.1109/CVPR.2017.35 ↗
35. Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. (2018). DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. CVPR, 8183–8192.10.1109/CVPR.2018.00854 ↗
36. Visualizing deep neural network by alternately image blurring and deblurring10.1016/j.neunet.2017.09.007 ↗
37. Tao, X., Gao, H., Shen, X., Wang, J., and Jia, J. (2018). Scale-Recurrent Network for Deep Image Deblurring. CVPR, 8174–8182.10.1109/CVPR.2018.00853 ↗
38. Motion Deblurring of Faces10.1007/s11263-018-1138-7 ↗
39. Shao, W., Liu, Y., Ye, L., Wang, L., Ge, Q., Bao, B., and Li, H. (2020). DeblurGAN+: Revisiting blind motion deblurring using conditional adversarial networks. Signal Process., 168.10.1016/j.sigpro.2019.107338 ↗
40. Shi, X., Chen, Z., Wang, H., Yeung, D., Wong, W., and Woo, W. (2015). Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting. arXiv.
41. Krishnan, D., and Fergus, R. (2009). Fast Image Deconvolution using Hyper-Laplacian Priors. NIPS, 1033–1041.
42. Image and depth from a conventional camera with a coded aperture10.1145/1276377.1276464 ↗
43. Contour Detection and Hierarchical Image Segmentation10.1109/TPAMI.2010.161 ↗
44. Köhler, R., Hirsch, M., Mohler, B.J., Schölkopf, B., and Harmeling, S. (2012). Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database. ECCV, 27–40.10.1007/978-3-642-33786-4_3 ↗