journal article·2024Open access

MIDNet: Deblurring Network for Material Microstructure Images

Jiaxiang Wang, Zhengyi Li, Peng Shi, Hongying Yu, Dongbai Sun

Computers, Materials & Continua· Volume 79· Issue 1

Abstract

Scanning electron microscopy (SEM) is a crucial tool in the field of materials science, providing valuable insights into the microstructural characteristics of materials. Unfortunately, SEM images often suffer from blurriness caused by improper hardware calibration or imaging automation errors, which present challenges in analyzing and interpreting material characteristics. Consequently, rectifying the blurring of these images assumes paramount significance to enable subsequent analysis. To address this issue, we introduce a Material Images Deblurring Network (MIDNet) built upon the foundation of the Nonlinear Activation Free Network (NAFNet). MIDNet is meticulously tailored to address the blurring in images capturing the microstructure of materials. The key contributions include enhancing the NAFNet architecture for better feature extraction and representation, integrating a novel soft attention mechanism to uncover important correlations between encoder and decoder, and introducing new multi-loss functions to improve training effectiveness and overall model performance.We conduct a comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theart deblurring methods. The experimental results demonstrate the applicability and effectiveness of MIDNet in the domain of deblurring material microstructure images, with a PSNR (Peak Signal-to-Noise Ratio) reaching 35.26 dB and an SSIM (Structural Similarity) of 0.946. Our dataset is available at: https://github.com/woshigui/MIDNet.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Image Processing Techniques and Applications · Advanced Image Processing Techniques · Image and Signal Denoising Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (35)

Show source-provided references
1. Scanning electron microscopy: Physics of image formation and microanalysis10.1088/0957-0233/11/12/703 ↗
2. De-noising filters for TEM (transmission electron microscopy) image of nanomaterials
3. The discriminative bilateral filter: An enhanced denoising filter for electron microscopy data10.1016/j.jsb.2006.03.030 ↗
4. Defocus image deblurring network with defocus map estimation as auxiliary task10.1109/TIP.2021.3127850 ↗
5. GANscan: Continuous scanning microscopy using deep learning deblurring10.1038/s41377-022-00952-z ↗
6. Enhancement of biomass material characterization images using an improved U-Net
7. Simple baselines for image restoration
8. Evaluation and development of deep neural networks for image super-resolution in optical microscopy10.1038/s41592-020-01048-5 ↗
9. Resolution enhancement in scanning electron microscopy using deep learning10.1038/s41598-019-48444-2 ↗
10. Computational estimation by scientific data mining with classical methods to automate learning strategies of scientists10.1145/3502736 ↗
11. Material microstructure affected machining: A review
12. Understanding and evaluating blind deconvolution algorithms
13. A neural approach to blind motion deblurring
14. Image forgery detection based on motion blur estimated using convolutional neural network10.1109/JSEN.2019.2928480 ↗
15. Rain streaks removal for single image via kernel-guided convolutional neural network10.1109/TNNLS.2020.3015897 ↗
16. Learning a convolutional neural network for non-uniform motion blur removal
17. Self-supervised blind image deconvolution via deep generative ensemble learning10.1109/TCSVT.2022.3207279 ↗
18. MedDeblur: Medical image deblurring with residual dense spatial-asymmetric attention10.3390/math11010115 ↗
19. Deep stacked hierarchical multi-patch network for image deblurring
20. HINet: Half instance normalization network for image restoration
21. Raw image deblurring10.1109/TMM.2020.3045303 ↗
22. Xu · Int. J. Prod. Res. · 2023 · 61 · 422010.1080/00207543.2021.2010827 ↗
23. Restormer: Efficient transformer for high-resolution image restoration
24. SCAF-Net: Scene context attention-based fusion network for vehicle detection in aerial imagery
25. Scale-aware attention-based multi-resolution representation for multi-person pose estimation10.1007/s00530-021-00795-5 ↗
26. D3-Net: Integrated multi-task convolutional neural network for water surface deblurring, dehazing and object detection10.1016/j.engappai.2022.105558 ↗
27. Dual-domain attention for image deblurring
28. Multi-stage attentive network for motion deblurring via binary cross-entropy loss10.3390/e24101414 ↗
29. Automatic defogging, deblurring, and real-time segmentation system for sewer pipeline defects10.1016/j.autcon.2022.104595 ↗
30. Human-aware motion deblurring
31. Deep attention-based lightweight network for aerial image deblurring
32. Attention-based interpolation network for video deblurring10.1016/j.neucom.2020.04.147 ↗
33. Language modeling with gated convolutional networks
34. D. Hendrycks and K. Gimpel, “Gaussian error linear units (gelus),” arXiv preprint arXiv:1606.08415, 2016.
35. Squeeze-and-excitation networks