journal article·2025-08-20Open access

SEM Image Segmentation Method for Copper Microstructures Based on Enhanced U-Net Modeling

Shiqi Yang, Jianpeng Zhu, Zhenfeng Cao, Minglai Yang, Ying Wang

Coatings· Volume 15· Issue 8

Abstract

Grain boundary segmentation in scanning electron microscope (SEM) images of pure copper presents substantial challenges for traditional image processing methods, including constrained segmentation precision and difficulties in identifying elongated grain boundaries and intricate topological structures. To overcome these constraints, this research introduces a comprehensive framework that integrates dataset development, advanced data augmentation, and model optimization to achieve precise grain boundary segmentation. This work proposes three principal innovations. First, a meticulously curated small-scale dataset, combined with a sophisticated adaptive data augmentation strategy, addresses data scarcity and ensures high-quality, robust training data. Second, the U-Net model was refined by incorporating a self-attention mechanism, markedly enhancing its capability to capture global contextual information and accurately detect complex grain boundary features. Third, an optimized stratified K-fold cross-validation method was implemented to ensure equitable data partitioning and reduce overfitting, thereby strengthening the model’s generalization capability. Experimental results demonstrate that the proposed framework delivers exceptional performance on the validation dataset, achieving a global accuracy of 0.96, a Dice coefficient of 0.91, and a mean Intersection over Union (mIoU) of 0.85. These metrics underscore significant advancements in grain boundary segmentation precision for polycrystalline metal systems. The framework validates the power of deep learning in microstructural characterization and establishes a reliable computational tool for quantitative metallographic analysis. It is well-positioned to extend to the microstructural analysis of a broad range of heterogeneous materials, enabling deeper insights into microstructure–property relationships in materials engineering.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Electron and X-Ray Spectroscopy Techniques · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Railway Transportation, Shanghai Institute of Technology, Shanghai 201418, China

College of Information Technology, Jilin Agricultural University, Changchun 130118, China

Center for Advanced Electronic Materials and Devices, Shanghai Jiao Tong University, Shanghai 200241, China

Funding

Jilin Agricultural University

References (26)

Show source-provided references
1. Rusanovsky, M., Beeri, O., and Oren, G. (2022). An End-to-End Computer Vision Methodology for Quantitative Metallography. Sci. Rep., 12.10.1038/s41598-022-08651-w ↗
2. Deep Learning Modeling in Microscopy Imaging: A Review of Materials Science Applications10.1016/j.pmatsci.2023.101165 ↗
3. Ultraviolet Single-Camera Stereo-Digital Image Correlation for Deformation Measurement up to 2600 °C10.1007/s11340-024-01087-5 ↗
4. Method for Grain Size Determination in Carbon Steels Based on the Ultimate Opening10.1016/j.measurement.2018.09.068 ↗
5. Automated Image Segmentation of Scanning Electron Microscopy Images of Graphene Using U-Net Neural Network10.1016/j.mtcomm.2023.106127 ↗
6. Grain size automatic determination for 7050 Al alloy based on a fuzzy logic method10.1016/S1875-5372(16)30070-4 ↗
7. New methods for automatic quantification of microstructural features using digital image processing10.1016/j.matdes.2017.12.049 ↗
8. Physical Metallurgy-Guided Machine Learning and Artificial Intelligent Design of Ultrahigh-Strength Stainless Steel10.1016/j.actamat.2019.08.033 ↗
9. Azimi, S.M., Britz, D., Engstler, M., Fritz, M., and Mücklich, F. (2018). Advanced steel microstructural classification by deep learning methods. Sci. Rep., 8.10.1038/s41598-018-20037-5 ↗
10. Addressing materials’ microstructure diversity using transfer learning10.1038/s41524-022-00703-z ↗
11. Development of high accuracy segmentation model for microstructure of steel by deep learning10.2355/isijinternational.ISIJINT-2019-568 ↗
12. A deep learning approach for complex microstructure inference10.1038/s41467-021-26565-5 ↗
13. Boundary learning by using weighted propagation in convolution network10.1016/j.jocs.2022.101709 ↗
14. Zhu, X., Zhu, Y., Kang, C., Liu, M., Yao, Q., Zhang, P., Huang, G., Qian, L., Zhang, Z., and Yao, Z. (2023). Research on automatic identification and rating of ferrite–pearlite grain boundaries based on deep learning. Materials, 16.10.3390/ma16051974 ↗
15. An Automated and Unbiased Grain Segmentation Method Based on Directional Reflectance Microscopy10.1016/j.matchar.2021.110978 ↗
16. A Survey on Image Data Augmentation for Deep Learning10.1186/s40537-019-0197-0 ↗
17. Liu, Z., Lv, Q., Li, Y., Yang, Z., and Shen, L. (2023). MedAugment: Universal Automatic Data Augmentation Plug-in for Medical Image Analysis. arXiv.
18. Deep Neural Networks for Human Activity Recognition with Wearable Sensors: Leave-One-Subject-Out Cross-Validation for Model Selection10.1109/ACCESS.2020.3010715 ↗
19. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs10.1109/TPAMI.2017.2699184 ↗
20. Navab, N., Hornegger, J., Wells, W., and Frangi, A. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Springer.10.1007/978-3-319-24553-9 ↗
21. U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications10.1109/ACCESS.2021.3086020 ↗
22. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. arXiv.
23. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv.
24. Attention Is All You Need
25. Wang, H., Xu, X., Liu, Y., Lu, D., Liang, B., and Tang, Y. (2023). Real-time defect detection for metal components: A fusion of enhanced Canny–Devernay and YOLOv6 algorithms. Appl. Sci., 13.10.3390/app13126898 ↗
26. A tutorial on the segmentation of metallographic images: Taxonomy, new MetalDAM dataset, deep learning-based ensemble model, experimental analysis and challenges10.1016/j.inffus.2021.09.018 ↗