Wavelet-Based, Blur-Aware Decoupled Network for Video Deblurring
Source abstract
Abstract
Video deblurring faces a fundamental challenge, as blur degradation comprehensively affects frames by not only causing detail loss but also severely distorting structural information. This dual degradation across low- and high-frequency domains makes it challenging for existing methods to simultaneously restore both structural and detailed information through a unified approach. To address this issue, we propose a wavelet-based, blur-aware decoupled network (WBDNet) that innovatively decouples structure reconstruction from detail enhancement. Our method decomposes features into multiple frequency bands and employs specialized restoration strategies for different frequency domains. In the low-frequency domain, we construct a multi-scale feature pyramid with optical flow alignment. This enables accurate structure reconstruction through bottom-up progressive feature fusion. For high-frequency components, we combine deformable convolution with a blur-aware attention mechanism. This allows us to precisely extract and merge sharp details from multiple frames. Extensive experiments on benchmark datasets demonstrate the superior performance of our method, particularly in preserving structural integrity and detail fidelity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Processing Techniques · Image and Signal Denoising Methods · Image and Video Stabilization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, Faculty of Informatics, Mahasarakham University, Maha Sarakham 44150, Thailand
Funding
Mahasarakham University
References (49)
Show source-provided references
1. Wang, H., and Schmid, C. (2013, January 1–8). Action recognition with improved trajectories. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.441 ↗
2. Sayed, M., and Brostow, G. (2021, January 20–25). Improved handling of motion blur in online object detection. Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00175 ↗
3. Jin, H., Favaro, P., and Cipolla, R. (2005, January 20–26). Visual tracking in the presence of motion blur. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
4. Gast, J., and Roth, S. (2019, January 27–28). Deep video deblurring: The devil is in the details. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea.10.1109/ICCVW.2019.00475 ↗
5. Wulff, J., and Black, M.J. (2014, January 6–12). Modeling blurred video with layers. Proceedings of the Computer Vision–ECCV 2014: 13th European Conference, Proceedings, Part VI 13, Zurich, Switzerland.
6. Hyun Kim, T., and Mu Lee, K. (2015, January 7–12). Generalized video deblurring for dynamic scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299181 ↗
7. Pan, J., Bai, H., and Tang, J. (2020, January 13–19). Cascaded deep video deblurring using temporal sharpness prior. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00311 ↗
8. Recurrent video restoration transformer with guided deformable attention
9. Zhang, H., Xie, H., and Yao, H. (2022, January 23–27). Spatio-temporal deformable attention network for video deblurring. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19787-1_33 ↗
10. Jiang, B., Xie, Z., Xia, Z., Li, S., and Liu, S. (2022, January 23–27). Erdn: Equivalent receptive field deformable network for video deblurring. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19797-0_38 ↗
11. Vdtr: Video deblurring with transformer10.1109/TCSVT.2022.3201045 ↗
12. Lin, J., Cai, Y., Hu, X., Wang, H., Yan, Y., Zou, X., Ding, H., Zhang, Y., Timofte, R., and Van Gool, L. (2022, January 17–23). Flow-Guided Sparse Transformer for Video Deblurring. Proceedings of the International Conference on Machine Learning, PMLR, Baltimore, MD, USA.
13. Vrt: A video restoration transformer10.1109/TIP.2024.3372454 ↗
14. Zou, W., Jiang, M., Zhang, Y., Chen, L., Lu, Z., and Wu, Y. (2021, January 11–17). Sdwnet: A straight dilated network with wavelet transformation for image deblurring. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00216 ↗
15. Dong, J., Pan, J., Yang, Z., and Tang, J. (2023, January 2–3). Multi-scale residual low-pass filter network for image deblurring. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01134 ↗
16. Pan, J., Xu, B., Dong, J., Ge, J., and Tang, J. (2023, January 17–24). Deep discriminative spatial and temporal network for efficient video deblurring. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.02125 ↗
17. Levin, A., Weiss, Y., Durand, F., and Freeman, W.T. (2011, January 20–25). Efficient marginal likelihood optimization in blind deconvolution. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.10.1109/CVPR.2011.5995308 ↗
18. Sun, L., Cho, S., Wang, J., and Hays, J. (2013, January 19–21). Edge-based blur kernel estimation using patch priors. Proceedings of the IEEE International Conference on Computational Photography (ICCP), Cambridge, MA, USA.
19. Image deblurring via enhanced low-rank prior10.1109/TIP.2016.2571062 ↗
20. Hyun Kim, T., Ahn, B., and Mu Lee, K. (2013, January 1–8). Dynamic scene deblurring. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.392 ↗
21. Pan, J., Hu, Z., Su, Z., Lee, H.Y., and Yang, M.H. (2016, January 27–30). Soft-segmentation guided object motion deblurring. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.56 ↗
22. Zheng, S., Xu, L., and Jia, J. (2013, January 1–8). Forward motion deblurring. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.185 ↗
23. Gong, D., Yang, J., Liu, L., Zhang, Y., Reid, I., Shen, C., Van Den Hengel, A., and Shi, Q. (2017, January 21–26). From motion blur to motion flow: A deep learning solution for removing heterogeneous motion blur. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.405 ↗
24. Sun, J., Cao, W., Xu, Z., and Ponce, J. (2015, January 7–12). Learning a convolutional neural network for non-uniform motion blur removal. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298677 ↗
25. Yan, Y., Ren, W., Guo, Y., Wang, R., and Cao, X. (2017, January 21–26). Image deblurring via extreme channels prior. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.738 ↗
26. Zhang, J., Pan, J., Ren, J., Song, Y., Bao, L., Lau, R.W., and Yang, M.H. (2018, January 18–23). Dynamic scene deblurring using spatially variant recurrent neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00267 ↗
27. Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. (2018, January 18–23). Deblurgan: Blind motion deblurring using conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00854 ↗
28. Nah, S., Hyun Kim, T., and Mu Lee, K. (2017, January 21–26). Deep multi-scale convolutional neural network for dynamic scene deblurring. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.35 ↗
29. Tao, X., Gao, H., Shen, X., Wang, J., and Jia, J. (2018, January 18–23). Scale-recurrent network for deep image deblurring. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00853 ↗
30. Zhang, H., Dai, Y., Li, H., and Koniusz, P. (2019, January 15–20). Deep stacked hierarchical multi-patch network for image deblurring. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00613 ↗
31. Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., and Gao, W. (2021, January 20–25). Pre-trained image processing transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01212 ↗
32. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.H. (2022, January 18–24). Restormer: Efficient transformer for high-resolution image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00564 ↗
33. Full-frame video stabilization with motion inpainting10.1109/TPAMI.2006.141 ↗
34. Video deblurring for hand-held cameras using patch-based synthesis10.1145/2185520.2185560 ↗
35. Hyun Kim, T., and Mu Lee, K. (2014, January 23–28). Segmentation-free dynamic scene deblurring. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.348 ↗
36. Su, S., Delbracio, M., Wang, J., Sapiro, G., Heidrich, W., and Wang, O. (2017, January 21–26). Deep video deblurring for hand-held cameras. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.33 ↗
37. Adversarial spatio-temporal learning for video deblurring10.1109/TIP.2018.2867733 ↗
38. Hyun Kim, T., Mu Lee, K., Scholkopf, B., and Hirsch, M. (2017, January 22–29). Online video deblurring via dynamic temporal blending network. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.435 ↗
39. Real-world video deblurring: A benchmark dataset and an efficient recurrent neural network10.1007/s11263-022-01705-6 ↗
40. Zhu, C., Dong, H., Pan, J., Liang, B., Huang, Y., Fu, L., and Wang, F. (March, January 28). Deep recurrent neural network with multi-scale bi-directional propagation for video deblurring. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.
41. Suin, M., Purohit, K., and Rajagopalan, A. (2020, January 13–19). Spatially-attentive patch-hierarchical network for adaptive motion deblurring. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00366 ↗
42. Li, D., Xu, C., Zhang, K., Yu, X., Zhong, Y., Ren, W., Suominen, H., and Li, H. (2021, January 20–25). Arvo: Learning all-range volumetric correspondence for video deblurring. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00763 ↗
43. Ranjan, A., and Black, M.J. (2017, January 21–26). Optical flow estimation using a spatial pyramid network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.291 ↗
44. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
45. Deep video deblurring using sharpness features from exemplars10.1109/TIP.2020.3023534 ↗
46. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., Yang, M.H., and Shao, L. (2021, January 20–25). Multi-stage progressive image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01458 ↗
47. LightViD: Efficient Video Deblurring with Spatial-Temporal Feature Fusion10.1109/TCSVT.2024.3369073 ↗
48. Deblurring Videos Using Spatial-Temporal Contextual Transformer with Feature Propagation10.1109/TIP.2024.3482176 ↗
49. Zhou, S., Zhang, J., Pan, J., Xie, H., Zuo, W., and Ren, J. (November, January 27). Spatio-temporal filter adaptive network for video deblurring. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.