MCIDN: Deblurring Network for Metal Corrosion Images
Source abstract
Abstract
The analysis of corrosion images is crucial in materials science, where acquiring clear images is fundamental for subsequent analysis. The goal of deblurring metal corrosion images is to reconstruct clear images from degraded ones. To the best of our knowledge, this study introduces the first paired blurry-sharp image dataset specifically designed for the metal corrosion domain, filling a critical gap in the existing research. This innovative approach effectively addresses the unique challenges associated with deblurring metal corrosion images. We propose a novel metal corrosion images deblurring network (MCIDN) that employs a dual-domain attention mechanism, integrating both spatial and frequency domains to enhance image clarity. This innovative approach effectively addresses the unique challenges associated with deblurring metal corrosion images. While self-attention is widely used in visual tasks, its quadratic complexity often leads to high computational costs. To address this issue, we introduce a new spatial channel attention module (SCAM) that employs dynamic group convolutions to achieve self-attention, effectively integrating information from local regions and enhancing representation learning capabilities. Recognizing the critical role of frequency components in image restoration, we develop a frequency channel attention module (FCAM) that selectively focuses on different frequency components of images, thereby enhancing deblurring performance. These two attention modules are seamlessly integrated into our network. Compared to existing methods, our approach demonstrates superior performance on datasets of blurry metal corrosion images, achieving a peak signal-to-noise ratio (PSNR) of 32.8645 dB and a structural similarity (SSIM) of 0.9768. These metrics indicate that our method provides clearer and more detailed reconstructions, significantly enhancing the image quality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Processing Techniques · Digital Media Forensic Detection · Image and Signal Denoising Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
National Center for Materials Service Safety, University of Science and Technology Beijing, Beijing 100083, China
Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China
School of Materials, Sun Yat-Sen University, Shenzhen 581007, China
School of Materials Science and Engineering, Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Sun Yat-Sen University, Guangzhou 581006, China
Funding
National Key R&D Program of China · National Science and Technology Major Project of China
References (63)
Show source-provided references
1. CorrDetector: A framework for structural corrosion detection from drone images using ensemble deep learning10.1016/j.eswa.2021.116461 ↗
2. Metal pitting corrosion characterized by scanning acoustic microscopy and binary image processing10.1016/j.corsci.2020.108685 ↗
3. Semantic deep learning integrated with RGB feature-based rule optimization for facility surface corrosion detection and evaluation10.1061/(ASCE)CP.1943-5487.0000982 ↗
4. Zhang, Z., Zheng, L., Piao, Y., Tao, S., Xu, W., Gao, T., and Wu, X. (2022). Blind remote sensing image deblurring using local binary pattern prior. Remote Sens., 14.10.3390/rs14051276 ↗
5. Robust blind deblurring under stripe noise for remote sensing images
6. Zeng, X., Dong, Q., and Li, Y. (2023). MG-CNFNet: A multiple grained channel normalized fusion networks for medical image deblurring. Biomed. Signal Process. Control, 82.10.1016/j.bspc.2023.104572 ↗
7. A deep learning based image enhancement approach for autonomous driving at night10.1016/j.knosys.2020.106617 ↗
8. MPDNet: An underwater image deblurring framework with stepwise feature refinement module10.1016/j.engappai.2023.106822 ↗
9. DWDN: Deep wiener deconvolution network for non-blind image deblurring10.1109/TPAMI.2021.3138787 ↗
10. Richardson-lucy deblurring for scenes under a projective motion path
11. Levin, A., Weiss, Y., Durand, F., and Freeman, W.T. (2009, January 20–25). Understanding and evaluating blind deconvolution algorithms. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, PMiami, FL, USA.10.1109/CVPRW.2009.5206815 ↗
12. Sparse representation for color image restoration10.1109/TIP.2007.911828 ↗
13. Image deblurring via enhanced low-rank prior10.1109/TIP.2016.2571062 ↗
14. Single image haze removal using dark channel prior
15. Zhang, H., Dai, Y., Li, H., and Koniusz, P. (2019, January 15–20). Deep stacked hierarchical multi-patch network for image deblurring. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00613 ↗
16. Chu, X., Chen, L., Chen, C., and Lu, X. (2022, January 23–27). Improving image restoration by revisiting global information aggregation. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-20071-7_4 ↗
17. Facial image deblurring network for robust illuminance adaptation and key structure restoration10.1016/j.engappai.2024.107959 ↗
18. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.H. (2022, January 18–24). Restormer: Efficient transformer for high-resolution image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00564 ↗
19. Joint low-light enhancement and deblurring with structural priors guidance10.1016/j.eswa.2024.123722 ↗
20. Tsai, F.J., Peng, Y.T., Lin, Y.Y., Tsai, C.C., and Lin, C.W. (2022, January 23–27). Stripformer: Strip transformer for fast image deblurring. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19800-7_9 ↗
21. Zou, W., Jiang, M., Zhang, Y., Chen, L., Lu, Z., and Wu, Y. (2021, January 11–17). Sdwnet: A straight dilated network with wavelet transformation for image deblurring. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00216 ↗
22. Mao, X., Liu, Y., Liu, F., Li, Q., Shen, W., and Wang, Y. (2023, January 7–14). Intriguing findings of frequency selection for image deblurring. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.
23. Multi-scale frequency separation network for image deblurring10.1109/TCSVT.2023.3259393 ↗
24. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE conference on computer vision and pattern recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
25. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014). Microsoft coco: Common objects in context. Computer Vision—ECCV 2014: Proceedings of the 13th European Conference, Zurich, Switzerland, 6–12 September 2014, Springer. Proceedings, Part V 13.
26. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
27. Zbontar, J., Knoll, F., Sriram, A., Murrell, T., Huang, Z., Muckley, M.J., Defazio, A., Stern, R., Johnson, P., and Bruno, M. (2018). fastMRI: An open dataset and benchmarks for accelerated MRI. arXiv.
28. The multimodal brain tumor image segmentation benchmark (BRATS)10.1109/TMI.2014.2377694 ↗
29. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports10.1038/s41597-019-0322-0 ↗
30. Xia, G.S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., and Zhang, L. (2018, January 18–23). DOTA: A large-scale dataset for object detection in aerial images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00418 ↗
31. A high resolution optical satellite image dataset for ship recognition and some new baselines10.5220/0006120603240331 ↗
32. Vision transformers for single image dehazing10.1109/TIP.2023.3256763 ↗
33. Chen, L., Chu, X., Zhang, X., and Sun, J. (2022, January 23–27). Simple baselines for image restoration. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-20071-7_2 ↗
34. Chen, X., Li, H., Li, M., and Pan, J. (2023, January 17–24). Learning a sparse transformer network for effective image deraining. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00571 ↗
35. Desnownet: Context-aware deep network for snow removal10.1109/TIP.2018.2806202 ↗
36. Benchmarking single-image dehazing and beyond10.1109/TIP.2018.2867951 ↗
37. Ancuti, C.O., Ancuti, C., Sbert, M., and Timofte, R. (2019, January 22–25). Dense-haze: A benchmark for image dehazing with dense-haze and haze-free images. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.10.1109/ICIP.2019.8803046 ↗
38. Nah, S., Hyun Kim, T., and Mu Lee, K. (2017, January 21–26). Deep multi-scale convolutional neural network for dynamic scene deblurring. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.35 ↗
39. Shen, Z., Wang, W., Lu, X., Shen, J., Ling, H., Xu, T., and Shao, L. (November, January 27). Human-aware motion deblurring. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, South Korea.
40. Yang, W., Tan, R.T., Feng, J., Liu, J., Guo, Z., and Yan, S. (2017, January 21–26). Deep joint rain detection and removal from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.183 ↗
41. Tao, X., Gao, H., Shen, X., Wang, J., and Jia, J. (2018, January 18–23). Scale-recurrent network for deep image deblurring. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00853 ↗
42. Gao, H., Tao, X., Shen, X., and Jia, J. (2019, January 15–20). Dynamic scene deblurring with parameter selective sharing and nested skip connections. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00397 ↗
43. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., Yang, M.H., and Shao, L. (2021, January 20–25). Multi-stage progressive image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01458 ↗
44. Cho, S.J., Ji, S.W., Hong, J.P., Jung, S.W., and Ko, S.J. (2021, January 11–17). Rethinking coarse-to-fine approach in single image deblurring. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00460 ↗
45. Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., and Timofte, R. (2021, January 11–17). Swinir: Image restoration using swin transformer. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00210 ↗
46. Kong, L., Dong, J., Ge, J., Li, M., and Pan, J. (2023, January 17–24). Efficient frequency domain-based transformers for high-quality image deblurring. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Montreal, BC, Canada.10.1109/CVPR52729.2023.00570 ↗
47. Li, Y., Fan, Y., Xiang, X., Demandolx, D., Ranjan, R., Timofte, R., and Van Gool, L. (2023, January 17–24). Efficient and explicit modelling of image hierarchies for image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Montreal, BC, Canada.10.1109/CVPR52729.2023.01753 ↗
48. Chen, L., Lu, X., Zhang, J., Chu, X., and Chen, C. (2021, January 20–25). Hinet: Half instance normalization network for image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPRW53098.2021.00027 ↗
49. Kupyn, O., Martyniuk, T., Wu, J., and Wang, Z. (November, January 27). Deblurgan-v2: Deblurring (orders-of-magnitude) faster and better. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, South Korea.
50. Zheng, S., Zhu, Z., Zhang, X., Liu, Z., Cheng, J., and Zhao, Y. (2020, January 13–19). Distribution-induced bidirectional generative adversarial network for graph representation learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00725 ↗
51. Exploring the potential of channel interactions for image restoration10.1016/j.knosys.2023.111156 ↗
52. Wang, J., Li, Z., Shi, P., Yu, H., and Sun, D. (2024). MIDNet: Deblurring Network for Material Microstructure Images. Comput. Mater. Contin., 79.10.32604/cmc.2024.046929 ↗
53. Qin, X., Wang, Z., Bai, Y., Xie, X., and Jia, H. (2020, January 7–12). FFA-Net: Feature fusion attention network for single image dehazing. Proceedings of the AAAI Conference on Artificial Intelligence, New York City, NY, USA.10.1609/aaai.v34i07.6865 ↗
54. Huang, J., Liu, Y., Zhao, F., Yan, K., Zhang, J., Huang, Y., Zhou, M., and Xiong, Z. (2022, January 23–27). Deep fourier-based exposure correction network with spatial-frequency interaction. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19800-7_10 ↗
55. Guo, S., Yong, H., Zhang, X., Ma, J., and Zhang, L. (2023). Spatial-frequency attention for image denoising. arXiv.
56. Li, C., Guo, C.L., Zhou, M., Liang, Z., Zhou, S., Feng, R., and Loy, C.C. (2023). Embedding fourier for ultra-high-definition low-light image enhancement. arXiv.
57. Deep residual fourier transformation for single image deblurring
58. Wavedm: Wavelet-based diffusion models for image restoration10.1109/TMM.2024.3359769 ↗
59. Chen, W.T., Fang, H.Y., Hsieh, C.L., Tsai, C.C., Chen, I., Ding, J.J., and Kuo, S.Y. (2021, January 20–25). All snow removed: Single image desnowing algorithm using hierarchical dual-tree complex wavelet representation and contradict channel loss. Proceedings of the IEEE/CVF International Conference on Computer Vision, Nashville, TN, USA.10.1109/ICCV48922.2021.00416 ↗
60. Clearing the skies: A deep network architecture for single-image rain removal10.1109/TIP.2017.2691802 ↗
61. A motion deblur method based on multi-scale high frequency residual image learning10.1109/ACCESS.2020.2985220 ↗
62. Spectral Dual-Channel Encoding for Image Dehazing10.1109/TCSVT.2023.3264717 ↗
63. Yin, B., Josselyn, N., Considine, T.A., Kelley, J.V., Rinderspacher, B., Jensen, R.E., Snyder, J.F., Zhang, Z., and Rundensteiner, E.A. (2021, January 22–25). Corrosion Image Data Set for Automating Scientific Assessment of Materials. Proceedings of the BMVC, Online.