journal article·2026-01-18Open access

Critical Review of Recent Advances in AI-Enhanced SEM and EDS Techniques for Metallic Microstructure Characterization

Gasser Abdelal, Chi-Wai Chan, Sean McLoone

Applied Sciences· Volume 16· Issue 2

Abstract

This critical review explores the transformative impact of artificial intelligence (AI), particularly machine learning (ML) and computer vision (CV), on scanning electron microscopy (SEM) and energy dispersive spectroscopy (EDS) for metallic microstructure analysis, spanning research from 2010 to 2025. It critically evaluates how AI techniques balance automation, accuracy, and scalability, analysing why certain methods (e.g., Vision Transformers for complex microstructures) excel in specific contexts and how trade-offs in data availability, computational resources, and interpretability shape their adoption. The review examines AI-driven techniques, including semantic segmentation, object detection, and instance segmentation, which automate the identification and characterisation of microstructural features, defects, and inclusions, achieving enhanced accuracy, efficiency, and reproducibility compared to traditional manual methods. It introduces the Microstructure Analysis Spectrum, a novel framework categorising techniques by task complexity and scalability, providing a new lens to understand AI’s role in materials science. The paper also evaluates AI’s role in chemical composition analysis and predictive modelling, facilitating rapid forecasts of mechanical properties such as hardness and fracture strain. Practical applications in steelmaking (e.g., automated inclusion characterisation) and case studies on high-entropy alloys and additively manufactured metals underscore AI’s benefits, including reduced analysis time and improved quality control. Extending prior reviews, this work incorporates recent advancements like Vision Transformers, 3D Convolutional Neural Networks (CNNs), and Generative Adversarial Networks (GANs). Key challenges—data scarcity, model interpretability, and computational demands—are critically analysed, with representative trade-offs from the literature highlighted (e.g., GANs can substantially augment effective dataset size through synthetic data generation, typically at the cost of significantly increased training time).
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Additive Manufacturing Materials and Processes · Microstructure and Mechanical Properties of Steels

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Aerospace Engineering Belfast, Queen’s University Belfast, Belfast BT9 5WA, UK

Electrical Engineering and Computer Science, School of Electronics, Queen’s University Belfast, Belfast BT9 5WA, UK

References (33)

Show source-provided references
1. Overview: Computer Vision and Machine Learning for Microstructural Characterization and Analysis10.1007/s11661-020-06008-4 ↗
2. Deep Learning for Semantic Segmentation of Defects in Advanced STEM Images of Steels10.1038/s41598-019-49105-0 ↗
3. Instance Segmentation for Direct Measurements of Satellites in Metal Powders and Automated Microstructural Characterization from Image Data10.1007/s11837-021-04713-y ↗
4. Chen, D., Guo, D., Liu, S., and Liu, F. (2020). Microstructure Instance Segmentation from Aluminum Alloy Metallographic Image Using Different Loss Functions. Symmetry, 12.10.3390/sym12040639 ↗
5. Microstructure exploration and an artificial neural network approach for hardness prediction in AlCrFeMnNiWx High-Entropy Alloys10.1016/j.jallcom.2020.153766 ↗
6. Predicting microstructure-dependent mechanical properties in additively manufactured metals with machine- and deep-learning methods10.1016/j.commatsci.2020.109599 ↗
7. Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., and García-Rodríguez, J. (2017). A Review on Deep Learning Techniques Applied to Semantic Segmentation. arXiv.10.1016/j.asoc.2018.05.018 ↗
8. Gotkowski, K., Gupta, S., Godinho, J.R.A., Tochtrop, C.G.S., Maier-Hein, K.H., and Isensee, F. (2023). ParticleSeg3D: A Scalable Out-of-the-Box Deep Learning Segmentation Solution for Individual Particle Characterization from Micro CT Images in Mineral Processing and Recycling. arXiv, Available online: https://arxiv.org/abs/2301.13319.10.1016/j.powtec.2023.119286 ↗
9. Tao, X., Zhang, D., Ma, W., Liu, X., and Xu, D. (2018). Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks. Appl. Sci., 8.10.3390/app8091575 ↗
10. Real-time Detection of Steel Strip Surface Defects Based on Improved YOLO Detection Network10.1016/j.ifacol.2018.09.412 ↗
11. Alqahtani, F., Al-Mughanam, T., Alharbi, G., Yousef, A.M.F., and Al-Duhaim, M.A. (2023). Deep Learning-Based Approach for Classifying the Severity of Metal Corrosion Using SEM Images. Lecture Notes in Mechanical Engineering, Springer.
12. Okubo, V.Y., Shimizu, K., Shivaram, B.S., and Kim, H.Y. (2026, January 12). Defect Detection, AI Style: How TM-CNN Is Changing Materials Science. Available online: https://hackernoon.com/defect-detection-ai-style-how-tm-cnn-is-changing-materials-science.
13. Deep Learning Object Detection in Materials Science: Current State and Future Directions10.1016/j.commatsci.2022.111527 ↗
14. Segmentation Studies on Al-Si-Mg Metallographic Images Using Various Different Deep Learning Algorithms and Loss Functions
15. Bayesian Particle Instance Segmentation for Electron Microscopy Image Quantification10.1021/acs.jcim.0c01455 ↗
16. Uncertainty-aware Particle Segmentation for Electron Microscopy at Varied Length Scales10.1038/s41524-024-01302-w ↗
17. Thermo Fisher Scientific (2026, January 12). XRF Technology for Elemental Analysis. Available online: https://www.thermofisher.com/us/en/home/industrial/spectroscopy-elemental-isotope-analysis/oes-xrd-xrf-analysis/x-ray-fluorescence.html.
18. Thermo Fisher Scientific (2026, January 12). EDS Analysis for Materials Science. Available online: https://www.thermofisher.com/us/en/home/materials-science/elemental-analysis.html.
19. Application of Machine Learning Techniques in Mineral Classification for Scanning Electron Microscopy—Energy Dispersive X-Ray Spectroscopy (SEM-EDS) Images10.1016/j.petrol.2020.108178 ↗
20. Deep Learning Regression for Quantitative LIBS Analysis10.1016/j.sab.2023.106634 ↗
21. AZoOptics (2026, January 12). The Convergence of XRF Technology and Machine Learning for Material Analysis. Available online: https://www.azooptics.com/Article.aspx?ArticleID=2578.
22. Nanoscale light element identification using machine learning aided STEM-EDS10.1038/s41598-020-70674-y ↗
23. Application of artificial intelligence technologies in metallographic analysis for quality assessment in the shipbuilding industry10.1016/j.heliyon.2022.e10002 ↗
24. Wang, Y., Li, X., Zhang, H., and Chen, L. (2025). Deep learning-driven medical image analysis for computational material science applications. Front. Mater., 12.10.3389/fmats.2025.1583615 ↗
25. Identification of microstructures critically affecting material properties using machine learning framework based on metallurgists’ thinking process10.1038/s41598-022-17614-0 ↗
26. Overview of application of automated SEM/EDS measurements for inclusion characterization in steelmaking10.1002/metm.18 ↗
27. Abdulsalam, M., Gao, N., Webler, B.A., and Holm, E.A. (2021). Prediction of Inclusion Types from BSE Images: RF vs. CNN. Front. Mater., 8.10.3389/fmats.2021.754089 ↗
28. Patil, P., Raffey, M.A., Sarwade, W.K., and Kawale, S. (2023, January 28). A comparison of classification methods: Naïve Bayes and support vector machine. Proceedings of the 6th International Conference on Globalisation: Implications for the 21st Century (ICCT19), Aurangabad, India.
29. Sun, Y., Hanhan, I., Sangid, M.D., and Lin, G. (2020). Predicting Mechanical Properties from Microstructure Images in Fiber-Reinforced Polymers using Convolutional Neural Networks. arXiv.
30. Deep learning analysis on microscopic imaging in materials science10.1016/j.mtnano.2020.100087 ↗
31. Generative adversarial network (GAN) enabled statistically equivalent virtual microstructures (SEVM) for modeling cold spray formed bimodal aluminum alloys10.1038/s41524-024-01219-4 ↗
32. Characterization of Nonmetallic Inclusions of Al-Killed Ca-Treated Steels by Automated SEM/EDS and Its Application to Industrial Case Studies10.1002/srin.202200152 ↗
33. Oxford Instruments (2026, January 12). AZtecSteel—Steel Inclusion Analysis. Nanoanalysis—Oxford Instruments. Available online: https://nano.oxinst.com/AZtecSteel.